Screen mirroring display system, screen mirroring display method and related apparatus
By generating eye protection content at the screen projection receiving terminal and adjusting the display method according to the screen projection content and ambient light parameters, the problem of visual fatigue during the screen projection process is solved and the user experience is improved.
Patent Information
- Application Number
- PCT/CN2023/138852
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-14
- Publication Date
- 2025-08-07
AI Technical Summary
During the screen projection process, viewers are prone to visual fatigue, and the existing technology has not effectively solved this problem.
By generating eye protection content at the screen projection receiving terminal, the display method is adjusted to reduce visual fatigue, including background processing and element quality improvement according to the type of screen projection content, ambient light parameters or user operations.
It effectively reduces the user's visual fatigue during screen projection and improves the viewing experience.
Smart Images

Figure CN2023138852_07082025_PF_FP_ABST
Abstract
Description
Screen projection display system, screen projection display method and related devices Technical Field
[0001] The present application relates to the field of electronic technology, and in particular to a screen projection display system, a screen projection display method and related devices. Background Art
[0002] Currently, screen projection technology is widely used in office and meeting scenarios. Users typically project content from one device onto a larger display. As viewing time on larger displays increases, viewers experience visual fatigue. Reducing the visual fatigue caused by screen projection is an urgent issue that needs to be addressed.
[0003] Summary of the Invention
[0004] The embodiments of the present application provide a screen projection display system, a screen projection display method and related devices, which can provide eye protection content in the screen projection scene and reduce the visual fatigue of the viewer.
[0005] In the first aspect, an embodiment of the present application provides a screen projection display system, which may include a first device and a second device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; the first device generates first display information of the target screen projection content, and sends the first display information to the second device; the second device generates first eye protection content corresponding to the target screen projection content based on the first display information; the second device displays the first eye protection content.
[0006] In an embodiment of the present application, when a first device projects a screen onto a second device, the second device can generate corresponding eye protection content based on the projected content. The second device displays the eye protection content, which can reduce the user's visual fatigue when viewing the projected content.
[0007] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the second device generates first eye protection content corresponding to the target screen projection content in accordance with the first display information in response to the first instruction. In the embodiment of the present application, the second device can generate eye protection content in accordance with the first instruction to reduce the user's visual fatigue when viewing the screen projection content. The triggering method of the first instruction can be flexible, so that the user can selectively use eye protection to display the screen projection content in the screen projection scene.
[0008] In a possible implementation, in the screen projection system provided in the embodiment of the present application, the first instruction is generated on the second device; or,
[0009] When the first device detects the second target operation, the first device sends the first instruction to the second device; or
[0010] The first device sends the first instruction to the second device based on the target projection content being content in an object of a preset type.
[0011] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations:
[0012] a first operation of the user on the input device of the second device;
[0013] a second operation performed by the user on a virtual key displayed by the second device;
[0014] a third operation of the user on the touch display device of the second device;
[0015] Preset voice control operations;
[0016] Preset gesture control operations.
[0017] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the second device generates the first eye protection content based on the first display information in response to detecting that the target screen projection content meets the first eye protection condition. In the embodiment of the present application, the second device can autonomously detect whether the target screen projection content meets the first eye protection condition. If the target screen projection content meets the first eye protection condition, the second device can generate eye protection content for the target screen projection content and display the eye protection content, thereby reducing the user's visual fatigue when viewing the screen projection content.
[0018] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the second device generates the first eye protection content according to the first display information in response to detecting that the ambient light parameters meet the second eye protection condition, and the ambient light parameters are sent by the first device, or the ambient light parameters are collected by the second device. In the embodiment of the present application, the second device can independently determine whether it is necessary to display the target screen projection content in a manner with an eye protection effect based on the ambient light conditions in the screen projection scene. If the ambient light parameters meet the second eye protection condition, the second device can generate eye protection content for the target screen projection content and display the eye protection content to reduce the user's visual fatigue when viewing the screen projection content.
[0019] In one possible implementation, in the screen projection system provided by the embodiment of the present application, the second device generates the first eye protection content according to the first display information in response to detecting that the target screen projection content is the content of an object of a preset type. In the embodiment of the present application, the second device can detect whether the target screen projection content belongs to an object of a preset type in the screen projection scene. If it belongs to the content of an object of a preset type, the second device can generate eye protection content for the target screen projection content and display the eye protection content to reduce the user's visual fatigue when watching the screen projection content. Objects of preset types may include but are not limited to any of the following types of objects: file processing type, browser type, code editing type, video playback type, video processing type. Among them, the file processing type may include processing any of the following document types: ppt type, word type, txt type, pdf type, excel type.
[0020] In one possible implementation, in the screen projection system provided by the embodiment of the present application, the first display information is a video stream;
[0021] The second device decodes the first display information to obtain the target projection content.
[0022] In a possible implementation, in the screen projection system provided by an embodiment of the present application, the second device identifies a background area in the target screen projection content;
[0023] The second device generates the first eye protection content based on the background area.
[0024] In an embodiment of the present application, during the process of the second device generating the first eye protection content of the target projection content, the second device can process the background area of the target projection content.
[0025] In a possible implementation, in the screen projection system provided in an embodiment of the present application, the second device identifies a target element in the target screen projection content;
[0026] The second device determines the background area in the target projection content based on the detected target element.
[0027] In an embodiment of the present application, the second device can determine the background area of the target projection content by detecting the target element in the target projection content.
[0028] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the second device performs background eye protection processing on the background area to obtain a target optimized background image;
[0029] The second device generates the first eye protection content based on the target optimized background image.
[0030] In an embodiment of the present application, the second device can perform eye protection processing on the image in the background area to obtain a target optimized background image. The second device can replace the original image in the background area with the target optimized background image to generate the first eye protection content. Alternatively, the second device can place the target element in the target projection content on the target optimized background image to generate the first eye protection content.
[0031] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0032] Set an image with a preset texture as the image in the target area;
[0033] adjusting the color of the image in the target area;
[0034] Performing grayscale processing on the image in the target area;
[0035] The target area is a partial area or the entire area of the background area.
[0036] In the embodiment of the present application, when the second device performs eye protection processing on the background area, the eye protection processing can be performed on part or all of the background area. The target area can be processed by changing the image of the target area, changing the color of the target area, or performing grayscale processing on the image of the target area.
[0037] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0038] The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
[0039] In an embodiment of the present application, during the process of the second device generating eye protection content, the background area can be processed for eye protection, and the quality of the target elements in the target projection content can be improved, so that the generated eye protection content has better eye protection effect and viewing effect.
[0040] In a second aspect, an embodiment of the present application provides a screen projection display system, including a first device and a second device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0041] The first device obtains target screen projection content;
[0042] The first device generates second eye protection content corresponding to the target screen projection content according to the target screen projection content;
[0043] The first device sends second display information of the second eye protection content to the second device;
[0044] The second device displays the second eye protection content according to the second display information.
[0045] In an embodiment of the present application, when a first device projects its screen onto a second device, the first device can generate corresponding eye protection content based on the projected content. The first device projects the eye protection content onto the second device, which then displays the eye protection content, thereby reducing visual fatigue for the user viewing the projected content.
[0046] In a possible implementation, in the screen projection system provided in an embodiment of the present application, the first device opens the target screen projection content and displays the target screen projection content in a preset display area;
[0047] The first device displays the second eye protection content in the display area and records the screen of the display area, and the generated video stream is the second display information.
[0048] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content in response to the second instruction according to the target screen projection content. In the embodiment of the present application, the first device can generate eye protection content according to the second instruction to reduce the visual fatigue of the user when watching the screen projection content. The triggering method of the second instruction can be flexible, so that the user can selectively use the eye protection method to display the screen projection content in the screen projection scene.
[0049] In a possible implementation, in the screen projection system provided in the embodiment of the present application, the second instruction is sent by the second device to the first device; or,
[0050] The first device generates the second instruction in response to detecting a second target operation; the second target operation is any one of the following operations:
[0051] a fourth operation of the user on the input device of the first device;
[0052] a fifth operation performed by the user on the virtual key displayed on the first device;
[0053] a sixth operation performed by the user on the touch display device of the first device;
[0054] Preset voice control operations;
[0055] Preset gesture control operations.
[0056] In one possible implementation, in the screen projection system provided in the embodiment of the present application, when the second device detects the first target operation, it sends the second instruction to the first device.
[0057] In one possible implementation, in the screen projection system provided by the embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content based on the target object being a file of a preset type. In the embodiment of the present application, the second device can detect whether the target screen projection content belongs to an object of a preset type in the screen projection scene. If it belongs to the content of an object of a preset type, the second device can generate eye protection content for the target screen projection content and display the eye protection content to reduce the user's visual fatigue when watching the screen projection content. Objects of preset types may include but are not limited to any of the following types of objects: file processing type, browser type, code editing type, video playback type, video processing type. Among them, the file processing type may include processing any of the following document types: ppt type, word type, txt type, pdf type, excel type.
[0058] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the first device generates the second eye protection content in response to detecting that the target screen projection content meets the first eye protection condition. In the embodiment of the present application, the second device can autonomously detect whether the target screen projection content meets the first eye protection condition. If the target screen projection content meets the first eye protection condition, the second device can generate eye protection content for the target screen projection content and display the eye protection content, thereby reducing the user's visual fatigue when viewing the projection content.
[0059] In one possible implementation, in the projection system provided by the embodiment of the present application, the first device generates the second eye protection content in response to detecting that the ambient light parameters meet the second eye protection condition. In the embodiment of the present application, the second device can independently determine whether it is necessary to display the target projection content in a manner with an eye protection effect based on the ambient light conditions in the projection scene. If the ambient light parameters meet the second eye protection condition, the second device can generate eye protection content for the target projection content and display the eye protection content, thereby reducing the user's visual fatigue when viewing the projection content.
[0060] In a possible implementation, in the screen projection system provided by an embodiment of the present application, the first device identifies a background area in the target screen projection content;
[0061] The first device generates the second eye protection content based on the background area.
[0062] In an embodiment of the present application, when the first device generates the second eye protection content of the target projection content, the first device can process the background area of the target projection content.
[0063] In a possible implementation, in the screen projection system provided by an embodiment of the present application, the first device identifies a target element in the target screen projection content;
[0064] The first device determines a background area in the target projection content based on the detected target element.
[0065] In an embodiment of the present application, the first device can determine the background area of the target projection content by detecting the target element in the target projection content.
[0066] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the first device performs background eye protection processing on the background area to obtain a target optimized background image;
[0067] The first device generates the second eye protection content based on the target optimized background image.
[0068] In an embodiment of the present application, the first device may perform eye protection processing on the image in the background area to obtain a target optimized background image. The first device may replace the original image in the background area with the target optimized background image to generate the second eye protection content. Alternatively, the first device may place the target element in the target projection content on the target optimized background image to generate the second eye protection content.
[0069] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0070] Set an image with a preset texture as the image in the target area;
[0071] adjusting the color of the image in the target area;
[0072] Performing grayscale processing on the image in the target area;
[0073] The target area is a partial area or the entire area of the background area.
[0074] In the embodiment of the present application, when the first device performs eye protection processing on the background area, the eye protection processing can be performed on part or all of the background area. The target area can be processed by one or more methods such as changing the image of the target area, changing the color of the target area, or performing grayscale processing on the image of the target area.
[0075] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the first device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0076] The first device optimizes the background image and the optimized elements according to the target to generate the second eye protection content.
[0077] In an embodiment of the present application, during the process of generating eye protection content, the first device can perform eye protection processing on the background area, and can also improve the quality of the target elements in the target projection content, so that the generated eye protection content has better eye protection effect and viewing effect.
[0078] In a third aspect, an embodiment of the present application provides a screen projection system, including a first device and a second device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0079] The first device generates first display information of the target screen projection content, and sends the first display information to the second device;
[0080] The second device obtains target ambient light parameters;
[0081] The second device determines display parameters according to the target ambient light parameters;
[0082] The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information;
[0083] The second device displays the third eye protection content.
[0084] In an embodiment of the present application, when the first device projects the screen to the second device, the second device can generate third eye protection content corresponding to the target projected content based on environmental conditions such as illumination or light in the projection scene, so that the third eye protection content can reduce the user's visual fatigue when viewing the projected content in the projection scene.
[0085] In one possible implementation, in the screen projection system provided in the embodiment of the present application, the second device is configured with multiple sets of display parameters;
[0086] A set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature;
[0087] The second device determines the target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters;
[0088] The second device adjusts the target projection content according to the parameters in the target group display parameters to generate the third eye protection content.
[0089] In the embodiment of the present application, the second pen can adjust one or more parameters of the second display screen, including contrast, saturation, hue, image quality, and color temperature, according to the environmental conditions of the projection scene. The target projection content is displayed using a display screen with an eye protection effect.
[0090] In one possible embodiment, the second device determines a target screen brightness corresponding to the target ambient light parameter based on a preset correspondence between the ambient light parameter and the screen brightness; and the second device displays the third eye protection content according to the target screen brightness. In an embodiment of the present application, the second device adjusts the screen brightness of the second device's display screen based on environmental conditions such as illumination or light in the projection scene, so that the second device can display the third eye protection content in accordance with the screen brightness of the display screen. The resulting viewing effect can reduce the user's visual fatigue.
[0091] In a possible implementation, in the screen projection system provided in the embodiment of the present application, the target ambient light parameter is sent by the first device to the second device.
[0092] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the first device sends a third instruction to the second device, where the third instruction carries the target ambient light parameter;
[0093] The second device adjusts the display parameter according to the target ambient light parameter in response to the third instruction.
[0094] In a possible implementation, in the screen projection system provided in the embodiment of the present application, the target ambient light parameters are collected by the second device.
[0095] In one possible implementation, in the screen projection system provided in an embodiment of the present application, the first device opens the target projection content and displays the target projection content in a preset display area; the first device records the screen of the display area, and the generated video stream is the first display information;
[0096] The second device decodes the first display information to obtain the target projection content.
[0097] On the other hand, an embodiment of the present application further provides a screen projection display method, including a first device and a second device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0098] The first device obtains target ambient light parameters and target projection content;
[0099] The first device determines display parameters according to the target ambient light parameters;
[0100] The first device generates fourth eye protection content corresponding to the target projection content according to the display parameters and the first display information;
[0101] The first device sends third display information of the fourth eye protection content to the second device.
[0102] In this embodiment, the process of the first device determining the display parameters can refer to the process of the second device determining the display parameters. The process of the first device generating the fourth eye protection content corresponding to the target projection content based on the display parameters and the target projection content can refer to the process of the second device generating the third eye protection content corresponding to the target projection content.
[0103] In a possible implementation, the second device displays fourth eye protection content according to the third display information.
[0104] In one possible implementation, the second device obtains the target ambient light parameter; the second device determines the target screen brightness based on the target ambient light parameter; and the second device displays the fourth eye protection content based on the target screen brightness and the third display information.
[0105] In a possible implementation, the second device determines the target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness.
[0106] In one possible implementation, the second device receives a target screen brightness sent by the first device, and displays the fourth eye protection content based on the target screen brightness and the third display information.
[0107] In a fourth aspect, an embodiment of the present application provides a screen projection display method, which is applied to a second device, wherein a first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0108] The method comprises:
[0109] The second device receives first display information of the target screen projection content, where the first display information is generated by the first device;
[0110] The second device generates first eye protection content corresponding to the target projection content according to the first display information;
[0111] The second device displays the first eye protection content.
[0112] In a fifth aspect, an embodiment of the present application provides a screen projection display method, which is applied to a first device, wherein the first device and a second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0113] The method comprises:
[0114] The first device obtains target screen projection content;
[0115] The first device generates first display information of the target projection content and sends the first display information to the second device, so that the second device generates first eye protection content corresponding to the target projection content.
[0116] In a sixth aspect, an embodiment of the present application provides a screen projection display method, which is applied to a first device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0117] The method comprises:
[0118] The first device obtains target screen projection content;
[0119] The first device generates second eye protection content corresponding to the target screen projection content according to the target screen projection content;
[0120] The first device sends second display information of the second eye protection content to the second device.
[0121] In a seventh aspect, an embodiment of the present application provides a screen projection display method, which is applied to a second device, wherein a first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0122] The method comprises:
[0123] The second device receives second display information, where the second display information is generated by the first device;
[0124] The second device displays second eye protection content according to the second display information.
[0125] In an eighth aspect, an embodiment of the present application provides a screen projection display method, which is applied to a second device, wherein a first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0126] The method comprises:
[0127] The second device receives first display information of the target screen projection content, where the first display information is generated by the first device;
[0128] The second device obtains target ambient light parameters;
[0129] The second device determines display parameters according to the target ambient light parameters;
[0130] The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information;
[0131] The second device displays the third eye protection content.
[0132] In a ninth aspect, an embodiment of the present application provides a screen projection display method, which is applied to a first device, wherein the first device and a second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0133] The method comprises:
[0134] The first device generates first display information of the target screen projection content, and sends the first display information to the second device;
[0135] The first device obtains target ambient light parameters and sends the target ambient light parameters to the second device, so that the second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information.
[0136] In a tenth aspect, an embodiment of the present application provides an electronic device that is communicatively connected to a first device, where the first device is a screen projection sending terminal and the electronic device is a screen projection receiving terminal; wherein the electronic device includes a display and a controller, wherein:
[0137] The display is configured to display content;
[0138] The controller is configured to:
[0139] Receiving first display information of target screen projection content, where the first display information is generated by a first device;
[0140] generating first eye protection content corresponding to the target projection content according to the first display information;
[0141] The first eye protection content is displayed.
[0142] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0143] In response to the first instruction, generating first eye protection content corresponding to the target projection content according to the first display information; or,
[0144] In response to detecting that the target projection content meets the first eye protection condition, generating the first eye protection content according to the first display information; or,
[0145] In response to detecting that an ambient light parameter meets a second eye protection condition, the first eye protection content is generated according to the first display information, where the ambient light parameter is sent by the first device or collected by the second device.
[0146] In a possible implementation manner, in the electronic device provided in the embodiment of the present application, the first instruction is generated on the electronic device; or,
[0147] When the first device detects the second target operation, the first device sends the first instruction to the electronic device; or
[0148] The first device sends the first instruction to the electronic device based on the target projection content being content in a file of a preset type.
[0149] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is further configured to execute:
[0150] The second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations:
[0151] a first operation of the user on the input device of the second device;
[0152] a second operation performed by the user on a virtual key displayed by the second device;
[0153] a third operation of the user on the touch display device of the second device;
[0154] Preset voice control operations;
[0155] Preset gesture control operations.
[0156] In a possible implementation, in the electronic device provided by an embodiment of the present application, the first display information is a video stream;
[0157] The controller is specifically configured to execute:
[0158] Decode the first display information to obtain the target projection content.
[0159] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0160] Identifying a background area in the target projection content;
[0161] The first eye protection content is generated based on the background area.
[0162] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is further configured to execute:
[0163] The second device identifies a target element in the target projection content;
[0164] The second device determines the background area in the target projection content based on the detected target element.
[0165] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0166] Performing background eye protection processing on the background area to obtain a target optimized background image;
[0167] The first eye protection content is generated based on the target optimized background image.
[0168] In one possible implementation, in the electronic device provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0169] Set an image with a preset texture as the image in the target area;
[0170] adjusting the color of the image in the target area;
[0171] Performing grayscale processing on the image in the target area;
[0172] The target area is a partial area or the entire area of the background area.
[0173] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0174] The second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0175] The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
[0176] In an eleventh aspect, an embodiment of the present application further provides an electronic device that is communicatively connected to a second device, wherein the electronic device is a screen projection sending terminal, and the first device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein:
[0177] The memory stores computer program instructions;
[0178] The controller executes the computer program instructions to implement:
[0179] Get the target screen content;
[0180] Generate first display information corresponding to the target projection content;
[0181] The first display information is sent to the second device so that the second device generates first eye protection content corresponding to the target projection content based on the first display information.
[0182] In a twelfth aspect, an embodiment of the present application further provides an electronic device that is communicatively connected to a second device, wherein the electronic device is a screen projection sending terminal and the first device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein:
[0183] The memory stores computer program instructions;
[0184] The controller executes the computer program instructions to implement:
[0185] Get the target screen content;
[0186] Generate second eye protection content corresponding to the target projection content according to the target projection content;
[0187] Sending second display information of the second eye protection content to the second device.
[0188] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is configured to execute:
[0189] Open the target screen projection content and display it in a preset display area;
[0190] The second eye protection content is displayed in the display area, and the display area is recorded, and the generated video stream is the second display information.
[0191] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is configured to execute:
[0192] In response to the second instruction, generating second eye protection content corresponding to the target projection content according to the target projection content; or,
[0193] Based on the target object being a file of a preset type, generating second eye protection content corresponding to the target projection content according to the target projection content; or
[0194] In response to detecting that the target projection content meets the first eye protection condition, generating the second eye protection content; or,
[0195] In response to detecting that the ambient light parameter meets the second eye protection condition, the second eye protection content is generated.
[0196] In a possible implementation manner, in the electronic device provided in the embodiment of the present application, the second instruction is sent by the second device to the electronic device; or,
[0197] The controller is configured to execute: in response to detecting a second target operation, generate the second instruction; the second target operation is any one of the following operations:
[0198] a fourth operation of the user on the input device of the first device;
[0199] a fifth operation performed by the user on the virtual key displayed on the first device;
[0200] a sixth operation performed by the user on the touch display device of the first device;
[0201] Preset voice control operations;
[0202] Preset gesture control operations.
[0203] In a possible implementation, in the electronic device provided by the embodiment of the present application, when the second device detects the first target operation, it sends the second instruction to the electronic device.
[0204] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0205] Identifying a background area in the target projection content;
[0206] The second eye protection content is generated based on the background area.
[0207] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0208] Identifying a target element in the target projection content;
[0209] Based on the detected target element, determine the background area in the target projection content.
[0210] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0211] Performing background eye protection processing on the background area to obtain a target optimized background image;
[0212] The second eye protection content is generated based on the target optimized background image.
[0213] In one possible implementation, in the electronic device provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0214] Set an image with a preset texture as the image in the target area;
[0215] adjusting the color of the image in the target area;
[0216] Performing grayscale processing on the image in the target area;
[0217] The target area is a partial area or the entire area of the background area.
[0218] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0219] Performing quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0220] The background image and the optimized elements are optimized according to the target to generate the second eye protection content.
[0221] In a thirteenth aspect, an embodiment of the present application further provides an electronic device that is communicatively connected to a first device, where the first device is a screen projection sending terminal and the electronic device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein:
[0222] The memory stores computer program instructions;
[0223] The controller executes the computer program instructions to implement:
[0224] receiving second display information;
[0225] Second eye protection content is displayed according to the second display information, where the second eye protection content is generated by the first device.
[0226] In a fourteenth aspect, an embodiment of the present application further provides an electronic device that is communicatively connected to a first device, where the first device is a screen projection sending terminal and the electronic device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein:
[0227] The memory stores computer program instructions;
[0228] The controller executes the computer program instructions to implement:
[0229] Receiving first display information of target screen projection content, where the first display information is generated by the first device;
[0230] Get target ambient light parameters;
[0231] determining display parameters according to the target ambient light parameters;
[0232] Based on the display parameters and the first display information, generating third eye protection content corresponding to the target projection content;
[0233] The third eye protection content is displayed.
[0234] In a possible implementation, in the electronic device provided in the embodiment of the present application, the controller is configured with multiple sets of display parameters;
[0235] A set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature;
[0236] The controller is specifically configured to execute:
[0237] Determining a target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters;
[0238] According to the various parameters in the target group display parameters, the target projection content is adjusted to generate the third eye protection content.
[0239] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is specifically configured to execute:
[0240] Determining a target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness;
[0241] The second device displays the third eye protection content according to the target screen brightness.
[0242] In a possible implementation, in the electronic device provided by the embodiment of the present application, the target ambient light parameter is sent by the first device to the electronic device.
[0243] In a possible implementation, in the electronic device provided in an embodiment of the present application, the first device sends a third instruction to the second device, where the third instruction carries the target ambient light parameter;
[0244] The controller is specifically configured to execute: in response to the third instruction, adjusting the display parameter according to the target ambient light parameter.
[0245] In a possible implementation, in the electronic device provided in an embodiment of the present application, the target ambient light parameter is collected by the electronic device.
[0246] In a possible implementation, in the electronic device provided by an embodiment of the present application, the first display information is a video stream;
[0247] The controller is specifically configured to execute: decoding the first display information to obtain the target projection content.
[0248] In a fifteenth aspect, an embodiment of the present application further provides an electronic device that is communicatively connected to a second device, wherein the electronic device is a screen projection sending terminal and the second device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein:
[0249] The memory stores computer program instructions;
[0250] The controller executes the computer program instructions to implement:
[0251] Generate first display information of the target screen projection content, and send the first display information to the second device;
[0252] Obtain target ambient light parameters and send the target ambient light parameters to the second device, so that the second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information.
[0253] In one possible implementation, in the electronic device provided in the embodiment of the present application, the controller is further configured to execute:
[0254] Open the target projection content and display it in a preset display area; record the display area, and the generated video stream is the first display information.
[0255] In a sixteenth aspect, an embodiment of the present application further provides an electronic device, comprising a memory and a controller, wherein:
[0256] The memory stores computer program instructions;
[0257] The controller executes the computer program instructions to implement: the steps or operations in any possible implementation manner of the fourth to ninth aspects.
[0258] In the seventeenth aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer executes a method in any possible implementation manner as described in aspects four to nine.
[0259] In aspect 18, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer performs the operations performed by the first device in any possible implementation manner of aspects 1 to 3.
[0260] In the nineteenth aspect, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer performs the operations performed by the second device in any possible implementation manner of any one of the first to third aspects.
[0261] In aspect 20, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program. When the computer program runs on a computer, the computer performs the operations performed by the electronic device in any possible implementation of aspects 10 to 16.
[0262] In the twenty-first aspect, a computer program product is also provided, comprising a computer program, which, when run on a computer, enables the computer to execute a method in any possible implementation manner of aspects 4 to 9.
[0263] In aspect 22, an embodiment of the present application further provides a chip, which is coupled to a memory in an electronic device, and is used to call a computer program stored in the memory and execute the steps performed by the first device or the second device in any of the aforementioned embodiments.
[0264] In addition, the technical effects brought about by the fourth to twenty-second aspects can refer to the technical effects brought about by different designs in the first, second or third aspects, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0265] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0266] FIG1A is a schematic diagram of an application scenario provided by an embodiment of the present application;
[0267] FIG1B exemplarily shows a schematic diagram of a software architecture;
[0268] FIG2 is a schematic diagram of the working process of the screen projection display system provided in one embodiment of the present application;
[0269] 3A to 3C are schematic diagrams of the working process of the screen projection display system provided in an embodiment of the present application;
[0270] 4A to 4D are schematic diagrams of the working process of the screen projection display system provided in an embodiment of the present application;
[0271] 5A and 5B are schematic diagrams of the working process of the screen projection display system provided in an embodiment of the present application;
[0272] 6A to 6C are schematic diagrams of eye protection content provided in embodiments of the present application;
[0273] FIG7 is a schematic diagram of the working process of the screen projection display system provided in one embodiment of the present application;
[0274] FIG8 is a schematic diagram of the working process of the screen projection display system provided in one embodiment of the present application;
[0275] FIG9 is a schematic diagram of the working process of the screen projection display system provided in one embodiment of the present application;
[0276] FIG10 is a schematic diagram of the working process of the screen projection display system provided in one embodiment of the present application;
[0277] 11A to 11C are schematic flow charts of screen projection and display methods provided in embodiments of the present application;
[0278] 12A to 12C are flowcharts of screen projection and display methods provided in embodiments of the present application;
[0279] 13A and 13B are schematic flow charts of a screen projection display method provided in an embodiment of the present application;
[0280] 14A to 14C are schematic flow charts of screen projection and display methods provided in embodiments of the present application;
[0281] 15A and 15B are schematic flow charts of a screen projection display method provided in an embodiment of the present application;
[0282] 16A and 16B are schematic flow charts of a screen projection display method according to an embodiment of the present application;
[0283] 17A to 17D are flowcharts of screen projection and display methods provided in embodiments of the present application;
[0284] FIG18 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0285] The at least one involved in the embodiments of the present application includes one or more; wherein, more means greater than or equal to two. In addition, it should be understood that in the description of this application, words such as "first" and "second" are only used for the purpose of distinguishing descriptions, and cannot be understood as expressing or implying relative importance, nor can they be understood as expressing or implying order. In the description of this application, "A and / or B" includes three options, namely including A; including B; and including A and B.
[0286] The technical solutions provided in the embodiments of this application are applicable to screen projection scenarios. Generally speaking, a screen projection scenario includes a screen projection sending terminal and a screen projection receiving terminal. In this application, the screen projection sending terminal is referred to as the sending terminal, and the screen projection receiving terminal is referred to as the receiving terminal. The sending terminal can send the content used for screen projection to the receiving terminal, and the receiving terminal displays it.
[0287] As shown in Figure 1A, the screen projection display system provided in an embodiment of the present application may include a first device and a second device. Among them, the first device can be used as a screen projection sending terminal, and the second device can be used as a screen projection receiving terminal. Optionally, the number of second devices in the screen projection display system can be one or more. This application does not impose too many restrictions on this. The number of first devices can be one or more.
[0288] In some possible application scenarios, the first device may be a mobile phone, tablet computer, personal computer, mobile phone, handwriting tablet, television, etc. The second device may be a large-screen device such as a display, an all-in-one computer, a tablet computer, a personal computer, a television, a game console, etc. It is understandable that in addition to the first device and the second device, the sending terminal and the receiving terminal may also have other names, for example, the sending terminal is an active screen projection device, and the receiving terminal is a passive screen projection device; or, the sending terminal is the main device, and the receiving terminal is the auxiliary device; or, the sending terminal is the source device, and the receiving terminal is the target device; or, the sending terminal is the first device, and the receiving terminal is the second device, etc., and this application does not limit this. Among them, the roles of the sending terminal and the receiving terminal can be interchanged, that is, the sending terminal can project the screen to the receiving terminal, and correspondingly, the receiving terminal can also project the screen to the sending terminal.
[0289] The first device may be a portable electronic device, such as a mobile phone, a tablet computer, a portable computer, a wearable device with wireless communication function (such as a smart watch, smart glasses, a smart bracelet, or a smart helmet, etc.), or a vehicle-mounted device, etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or other portable electronic devices with other operating systems. The second device can be a large-screen device such as a tablet computer, a personal computer, a television, a commercial all-in-one machine, an interactive all-in-one machine with a touch function, etc.
[0290] The screen projection display system provided in the embodiment of the present application may include at least one first device and at least one second device. In other words, the screen projection display system may include at least one sending terminal and at least one receiving terminal. The following is an introduction to the screen projection display system in which the first device projects part or all of the content of the target object. The target object can be understood as a display object selected by the user, such as a file, video, picture, application, etc. Optionally, the target object can be an object stored in the first device. Or the target object can be an object received by the first device. Alternatively, the first device can obtain the target object from a storage device connected to the first device. The embodiment of the present application does not specifically limit this. In some application scenarios, the user can open the target object at the first device, and the first device displays the target object.
[0291] The first device and the second device can be communicatively connected. In some examples, the first device and the second device can communicate wirelessly. Optionally, the first device and the second device can achieve wireless communication based on any existing wireless communication technology. In some possible ways, the first device and the second device can be wirelessly connected based on WiFi technology. The first device and the second device are both connected to the same local area network. In other possible ways, one of the first device or the second device has a wireless hotspot function, and the other device can achieve wireless communication between the first device and the second device by connecting to the hotspot. Optionally, the first device may include a screen projector. Or the first device can be connected to a screen projector. The screen projector can be communicatively connected to the second device, such as a wireless communication connection or a wired communication connection. The screen projector can be used to pair with the second device so that the device connected to the screen projector (i.e., the first device) can project the screen to the second device.
[0292] In some possible embodiments, a first device and a second device are communicatively connected, and a target object can be transmitted between the first device and the second device based on a screen projection protocol. The screen projection display protocol may include, but is not limited to: a wireless display standard (Miracast) protocol, a digital living network alliance (DLNA) protocol, and a private screen projection protocol. The private screen projection protocol can be compatible with screen projection of one or more operating systems.
[0293] The first device can project a user-selected target object onto the scene on the second device. The first device can also project part or all of the target object's content onto the second device. The target object can include, but is not limited to, any of the following: files, images, videos, application display interfaces, or the first device's screen display.
[0294] In some examples, the first device projects the target object onto the scene on the second device, and the screen of the first device can display part or all of the content of the target object. The first device can record and encode the display content on the screen (or screen window) of the first device, generate display information of the display content and send it to the second device, so that the second device can obtain the display content based on the received display information, so as to display the display content on the second device. Optionally, the screen of the first device can be the display interface of the first device, or a virtual display window in the background of the first device.
[0295] In this example, the first device records the area displaying the target object and encodes it to obtain a video stream. This video stream can be used as display information of the target object or its content. The first device sends this display information to the second device. The second device can decode the received display information to obtain the displayed content. In other words, the second device can decode the received video stream to obtain the content of the target object.
[0296] In other examples, the first device can combine the type of the target object (object type) and use a transmission protocol that supports the object type to send the target object to the second device. For example, the first device can use the hypertext transfer protocol (http) to transfer files, videos, pictures, and other objects to the second device, so that the second device can obtain the target object. The first device can then use a transmission protocol that supports the type of the target object to generate display information corresponding to part or all of the content in the target object and send it to the second device, so that the second device can obtain part or all of the content in the target object.
[0297] In some other examples, the first device can register the target object on a DLNA network. The second device can obtain the target object from the first device using the target object's registration information on the DLNA network. The first device can then generate display information corresponding to part or all of the target object's content based on the DLNA network's transmission method and send it to the second device, allowing the second device to obtain part or all of the target object's content.
[0298] In some other examples, the first device can detect (or identify) part or all of the content in the target object, and detect elements in any part of the content in the target object. The display information of any part of the content may include data of any element in any part of the content in a data format (recorded as element data). Optionally, the display information may also include information on the data format used by each element data. In the present application, elements may include but are not limited to elements of types or forms such as text and pictures. Among them, text-type elements may include but are not limited to: text, characters, symbols and other forms of expression in any language. Picture-type elements may include but are not limited to: pictures in any picture format, or video frames in a video. Alternatively, the display information of any part of the content may include video data, and the video data may be obtained by recording the screen of any part of the content. The second device can obtain any part of the content based on the display information. In the present application, for ease of introduction, text-type elements are referred to as text elements. Picture-type elements are referred to as picture elements.
[0299] In one possible implementation, in the screen projection display system provided in the embodiment of the present application, the first device and the second device may be provided with an Android system, an iOS system, a Windows system, a Hongmeng system, etc. Taking the Android system as an example, FIG1B exemplarily shows a software architecture diagram.
[0300] In some embodiments, the Android system is divided into four layers, which are, from top to bottom, the application layer, the application framework layer, the Android runtime (Android Runtime) and system library, and the kernel layer.
[0301] The application layer may include a series of application packages. As shown in FIG1B , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.
[0302] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. As shown in Figure 1B, the application framework layer can include a window manager (WindowManager), content provider, view system, telephony manager, resource manager, notification manager, etc.
[0303] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, take screenshots, etc. The content provider is used to store and obtain data and make this data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can be composed of one or more views. For example, the display interface including the SMS notification icon can include a view for displaying text and a view for displaying images.
[0304] The phone manager is used to provide communication functions for electronic devices. For example, the management of call status (including answering, hanging up, etc.). The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the status bar at the top of the system in the form of an icon or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt tone is emitted, the communication terminal vibrates, the indicator light flashes, etc.
[0305] The Android Runtime consists of core libraries and a virtual machine (VM). The Android Runtime is responsible for scheduling and management of the Android system. The core libraries consist of two parts: one containing the Java language's callable functions and the other the Android core library. The application layer and the application framework layer run in the VM. The VM executes the Java files in the application layer and application framework layer as binary files. The VM is responsible for performing functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0306] The system library can include multiple functional modules. For example: surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc. The surface manager is used to manage the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as MPEG4, H.334, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing.
[0307] A 2D graphics engine is a drawing engine for 2D drawings.
[0308] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.
[0309] In actual application scenarios, users use a sending terminal to project content onto a receiving terminal for display. Receiving terminals typically have larger screens or display areas. Projected content typically includes large areas of text and blank space, which can easily cause visual fatigue for viewers who watch for extended periods of time. Therefore, receiving terminals are typically equipped with eye protection components to alleviate visual fatigue. However, this is limited by the structure of the receiving terminal itself and relies on its own eye protection capabilities. Using other receiving terminals without eye protection for projection can still cause visual fatigue.
[0310] In view of this, the embodiments of the present application provide a screen projection display system, a screen projection display method and related equipment, which can flexibly project the screen, and the viewing effect presented by the projection screen has an eye protection effect, can relieve the viewer's visual fatigue, and does not rely on the eye protection components in the hardware structure of the receiving terminal.
[0311] The present application provides a screen projection and display system. In this system, after a first device projects target screen content onto a second device, the second device can generate eye protection content with an eye protection effect corresponding to the target screen content (hereinafter referred to as the eye protection content corresponding to the target screen content) and display the eye protection content. This eye protection content can improve viewing experience and relieve visual fatigue of viewers.
[0312] Figure 2 shows a schematic diagram of the working process of a screen projection display system provided by an embodiment of the present application. In the screen projection display system, the first device can project part or all of the content of the target object onto the second device. Optionally, the first device may have a screen projection function, which can project the file selected by the user onto the second device. Alternatively, the first device has a screen projection application, and after the screen projection application is run, it can project the object selected by the user onto the second device. Among them, the first device projects the target object into the scene of the second device, and the first device may display the content in the target object or not.
[0313] In an embodiment of the present application, the target projection content may refer to part or all of the content in the target object. Or the target projection content may refer to the content being viewed in the projection scene. Optionally, the target projection content may be the content being displayed by the first device. Optionally, the user may open the target projection content on the first device, and the preset display area of the first device may display the target projection content, and then record and encode the display area to obtain video stream data, so that the first device generates display information of the target projection content. The first device may send the video stream data to the second device. The second device may decode the video stream data to obtain the target projection content.
[0314] As shown in (a) of Figure 2. The first device can project the target screen content to the second device. The first device can generate display information of the target screen content, which is convenient for distinguishing and recording as the first display information. And send the first display information to the second device. The second device can generate eye protection content corresponding to the target screen content based on the first display information, which is convenient for distinguishing and recording as the first eye protection content. As shown in (b) of Figure 2, the first eye protection content is displayed on the second device.
[0315] In one possible design, the second device can be provided with multiple projection display modes, which may include a normal display mode and an eye protection display mode. When the second device operates in normal display mode, the second device can receive the first display information of the target projection content and can display the target projection content according to the first display information. When the second device operates in eye protection display mode, the second device can receive the first display information of the target projection content and can generate the first eye protection content corresponding to the target projection content according to the first display information and display the first eye protection content.
[0316] Optionally, the second device can run in the eye protection display mode by default after it is turned on. Eye protection content corresponding to the corresponding content can be generated based on the received display information, and the eye protection content can be displayed. When the second device detects that the projection display mode is adjusted to the normal display mode, the second device can switch to run in the normal display mode. Alternatively, the second device can run in the normal display mode by default after it is turned on, and when the second device detects that the projection display mode is adjusted to the eye protection display mode, the second device can switch to run in the eye protection display mode.
[0317] In another possible design, the second device can respond to the first instruction and generate first eye protection content corresponding to the target projection content based on the first display information.
[0318] In some examples, the first instruction may be generated on the second device. For example, the second device may generate the first instruction in response to detecting a first target operation. The first target operation may be understood as an operation performed by a user on the second device. Optionally, the first target operation may include, but is not limited to, any of the following operations:
[0319] a first operation of the user on the input device of the second device;
[0320] a second operation performed by the user on a virtual key displayed by the second device;
[0321] a third operation of the user on the touch display device of the second device;
[0322] Preset voice control operations;
[0323] Preset gesture control operations.
[0324] In some possible scenarios, the second device detects a first operation performed by a user on an input device of the second device, which may trigger the second device to generate a first instruction. Optionally, the input device on the second device may be a hardware button, as shown in (a) in FIG3A , and the first operation may include but is not limited to: pressing a hardware button, pressing a hardware button multiple times in succession, and long pressing a hardware button for a preset time. Alternatively, the input device on the second device may be a knob, as shown in (b) in FIG3A , and the first operation may include but is not limited to: rotating the knob to a preset position. Alternatively, the input device on the second device may be a switch, as shown in (c) in FIG3A , and the first operation may include but is not limited to: turning the switch on or off.
[0325] In other possible scenarios, as shown in FIG3B , the second device detects a second operation of the user on a virtual key for the eye protection function displayed on the second device, which may trigger the second device to generate a first instruction. Optionally, the user may perform a second operation on the virtual key through a command input device. The command input device may include, but is not limited to, input devices such as a mouse, keyboard, touch screen, remote control, and writing pen. The second operation may include, but is not limited to: clicking a virtual key once, clicking a virtual key continuously, or long pressing a virtual key for a preset time.
[0326] Optionally, when the second device detects that the target projection content is the content of an object of a preset type, it can display a virtual button for the eye protection function. The object of the preset type can be pre-configured. The object of the preset type can include but is not limited to any of the following types of objects: file processing type, browser type, code editing type, video playback type, video processing type. Among them, the file processing type can include processing any of the following document types: ppt type, word type, txt type, pdf type, excel type.
[0327] For example, the second device can identify whether the target screen projection content contains the identifier of a preset type of object, such as a text identifier or a picture identifier, based on image recognition technology. The text identifier can be the name of the object or the abbreviation of the name, and the picture identifier can be a thumbnail or logo of the object. If the second device recognizes that the target screen projection content contains the identifier of an object of a preset type, it can be determined that the target screen projection content is detected to be content of an object of the preset type. If the second device recognizes that the target screen projection content does not contain the identifier of an object of the preset type, it can be determined that the target screen projection content is not detected to be content of an object of the preset type.
[0328] Optionally, when the first device detects that the target projection content is content of a preset type of object, it can send the type information of the object to which the target projection content belongs to the second device. The second device can display the virtual button of the eye protection function based on the type information of the object to which the target projection content belongs being the preset type.
[0329] Among them, in some implementations, the first device can detect whether the application package name of the foreground running object is the application package name of an object of a preset type, thereby detecting the file type of the running object. For example, the first device can detect whether the application package name of the target object to which the target screen projection content belongs is the application package name of an object of a preset type, thereby enabling the first device to detect whether the target screen projection content is the content of an object of a preset type. If the first device detects that the application package name of the target object to which the target screen projection content belongs is consistent with the application package name of an object of a preset type, then it is detected that the target screen projection content is the content of an object of a preset type.
[0330] In other implementations, the first device can use image recognition technology to identify whether the target screen projection content contains an identifier of a preset type of object, such as a text identifier or an image identifier. In still other implementations, the first device can identify whether the target screen projection content is a document and send the identified document type information to the second device, so that the second device can display a virtual button for the eye protection function based on the received file type information that is the preset file type.
[0331] Optionally, upon detecting that the target projection content is content of a preset type of object, the second device may display a virtual button for the eye protection function on the second device, as shown in FIG3B . If the virtual button is not processed within the first preset time period, the virtual button will not be displayed. If the user watches for more than the second preset time period, the second device may display the virtual button for the eye protection function again to prompt the user to watch in an eye-protective manner.
[0332] In some other possible scenarios, as shown in FIG3C , the second device may detect a user's third operation on a touch-sensitive display device of the second device, which may trigger the second device to generate the first instruction. Optionally, the touch-sensitive display device may be implemented as a touch screen. The third operation may include, but is not limited to, sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0333] In some other possible scenarios, the second device may have audio collection capabilities. The second device detects a user's preset voice control operation on the second device. For example, the second device may collect audio and recognize that the audio includes preset voice commands. The preset voice commands may include, but are not limited to, "turn on eye protection mode," "enter eye protection mode," "switch eye protection mode," and other voice commands with the same or similar meanings.
[0334] In some other possible scenarios, the second device may have image acquisition capabilities and gesture recognition capabilities. The user can perform preset gesture control operations by performing air gestures within the image acquisition range of the second device. The second device can detect whether the user has performed a preset gesture control operation by detecting whether the captured image includes a preset gesture. Optionally, in this example, the air gesture can be a static gesture, or the air gesture can be a dynamic gesture.
[0335] In other examples, as shown in FIG4A , the first instruction may be sent from the first device to the second device. The first instruction may be generated by the first device. For example, the first device may send the first instruction to the second device in response to detecting the second target operation.
[0336] The second target operation can be understood as the user's operation on the first device. Optionally, the second target operation can include but is not limited to any of the following operations:
[0337] a fourth operation of the user on the input device of the first device;
[0338] a fifth operation performed by the user on the virtual key displayed on the first device;
[0339] a sixth operation performed by the user on the touch display device of the first device;
[0340] Preset voice control operations;
[0341] Preset gesture control operations.
[0342] In some possible situations, the first device detects a fourth operation performed by the user on the input device of the first device, which may trigger the first device to generate a first instruction. Optionally, the input device on the first device may be a hardware button, as shown in (a) in FIG4B , and the fourth operation may include but is not limited to: pressing the hardware button, pressing the hardware button multiple times in succession, and long pressing the hardware button for a preset time. Alternatively, the input device on the first device may be a knob, as shown in (b) in FIG4B , and the fourth operation may include but is not limited to: rotating the knob to a preset position. Alternatively, the input device on the first device may be a switch, as shown in (c) in FIG4B , and the fourth operation may include but is not limited to: turning the switch on or off.
[0343] In other possible scenarios, as shown in FIG4C , the first device detects a fifth operation performed by the user on a virtual key for the eye protection function displayed on the first device, which may trigger the first device to generate a first instruction. Optionally, the user may perform the fifth operation on the virtual key through a command input device. The command input device may include, but is not limited to, input devices such as a mouse, keyboard, touch screen, remote control, and writing pen. The fifth operation may include, but is not limited to: clicking a virtual key once, clicking a virtual key continuously, or long pressing a virtual key for a preset time.
[0344] In some implementations, the first device may display a virtual button for the eye protection function when it detects that the target projection content is content in an object of a preset type. The object of the preset type may be pre-configured. The object of the preset type may include, but is not limited to, any of the following types of objects: file processing type objects, browser type, code editing type, video playback type, and video processing type objects. Among them, the object of the file processing type may include an object that processes any of the following document types: ppt type, word type, txt type, pdf type, and excel type.
[0345] For example, the first device can identify whether the target screen projection content contains an identifier of an object of a preset type, such as a text identifier or a picture identifier, based on image recognition technology. The text identifier can be the name of the object or the abbreviation of the name, and the picture identifier can be a thumbnail or logo of the object. If the first device recognizes that the target screen projection content contains an identifier of an object of a preset type, it can be determined that the target screen projection content is detected to be content of an object of the preset type. If the first device recognizes that the target screen projection content does not contain an identifier of an object of the preset type, it can be determined that the target screen projection content is not detected to be content of an object of the preset type.
[0346] For another example, the first device can detect whether the application package name of the foreground running object is the application package name of an object of a preset type, thereby detecting the file type of the running object. For example, the first device can detect whether the application package name of the target object to which the target screen projection content belongs is the application package name of an object of a preset type, thereby detecting whether the target screen projection content is content in an object of a preset type. If the first device detects that the application package name of the target object to which the target screen projection content belongs is consistent with the application package name of an object of a preset type, then it is detected that the target screen projection content is content in an object of a preset type.
[0347] For another example, the first device can identify whether the target projection content contains an identifier of a preset type of object, such as a text identifier or a picture identifier, based on image recognition technology.
[0348] In other implementations, the second device can detect whether the target screen projection content is the content of an object of a preset type, and send the type information of the target object to which the target screen projection content belongs to the first device. The first device can display the virtual button of the eye protection function based on the type information of the target object to which the target screen projection content belongs being the preset type. Alternatively, the second device can identify whether the target screen projection content is a document, and send the identified document type information to the first device, so that the first device can display the virtual button of the eye protection function based on the information that the received file type information is the preset file type.
[0349] In some other possible scenarios, as shown in FIG4D , the first device may detect a user's sixth operation on a touch-sensitive display device of the first device, which may trigger the first device to generate a first instruction. Optionally, the touch-sensitive display device may be implemented as a touch screen. The sixth operation may include, but is not limited to, sliding on the touch screen to form a track, or sliding on the touch screen to form a graphic.
[0350] In some other possible scenarios, the first device may have audio collection capabilities. The first device detects a user's preset voice control operation on the first device. For example, the first device may collect audio and recognize that the audio includes preset voice commands. Preset voice commands may include, but are not limited to, voice content with the same or similar meanings such as "turn on eye protection mode", "enter eye protection mode", "switch eye protection mode", and "eye protection screen projection".
[0351] In some other possible scenarios, the first device may have image acquisition capabilities and gesture recognition capabilities. The user can perform a preset gesture control operation by performing an air gesture within the image acquisition range of the first device. The first device can detect whether the user has performed a preset gesture control operation by detecting whether the captured image includes a preset gesture. Optionally, in this example, the air gesture can be a static gesture, or the air gesture can be a dynamic gesture.
[0352] In some other possible situations, according to the above introduction, the target projection content is part or all of the content of the target object. The first device can pre-detect the type of the target object to which the target projection content belongs. After the first device detects the projection operation of the target projection content, the first device can determine whether to generate a first instruction based on the type of the target object. For example, the first device can generate a first instruction based on the fact that the type of the target object is the aforementioned preset type, and send the first instruction to the second device. The first device automatically determines whether to control (or instruct) the second device to perform eye-protection projection based on the file type of the object to which the target projection content belongs. Optionally, the aforementioned preset types in this example include but are not limited to any of the following types of objects: file processing type, browser type, code editing type, video playback type, video processing type. Among them, the file processing type may include processing any of the following document types: ppt type, word type, txt type, pdf type, excel type.
[0353] In another possible design, after receiving the first display information, the second device can obtain the target projection content. The second device can detect whether the target projection content meets the first eye protection condition. In response to detecting that the target projection content meets the first eye protection condition, the second device can generate the first eye protection content corresponding to the target projection content.
[0354] Optionally, the first eye protection condition may include one or more of the following conditions:
[0355] Condition 1: The ratio of the sum of the number of pixels of all text-type elements in the target projection content to the total number of pixels of the target projection content is greater than or equal to the first pixel ratio threshold. Optionally, the first pixel ratio threshold can be configured as 10%.
[0356] Condition 2: There is a blank area in the target projection content, and the number of pixels in at least one blank area is greater than or equal to the second pixel ratio threshold. Optionally, the second pixel ratio threshold can be configured as 40%.
[0357] Condition 3: There is blank area in the target projection content.
[0358] Condition 4: The layout of the target projection content meets the preset layout conditions.
[0359] The second device may pre-store the number of pixels corresponding to text type elements of various font sizes at different projection screen resolutions. Thus, the second device can determine the total number of pixels of all text type elements in the target projection screen content. For example, if the projection screen resolution is 1920*1080, the number of pixels of text (or characters) in size 3 font is 20px.
[0360] Figure 5A shows an example of a target projection content. The blank area can be determined in such a way that the second device can extract the feature values of the screen image when the target projection content is normally displayed, and perform color segmentation by clustering. Thus, multiple color areas can be obtained. Among them, the color area with the target color can be determined as the blank area. The target color can be a color of a pre-set first color number, or the target color can be the color of any one of a plurality of pre-set first color numbers.
[0361] The second device can determine the number of pixels in the blank area based on the area of the blank area and the size (area) of one pixel. The second device can determine the number of pixels in the target projection content based on the area of the display range where the target projection content is located and the size (area) of one pixel.
[0362] The layout of the target projection content may include information of one or more dimensions. For example, information of the position dimension: the position of text elements, the position of picture elements, and the relative position relationship between text elements and picture elements. Information of the pixel number dimension: the number of pixels of text elements, the number of pixels of picture elements. For another example, information of the scale dimension, the ratio of the total pixels of text elements to the total pixels of target projection content, and the ratio of the total pixels of picture elements to the total pixels of target projection content. Among them, the preset layout conditions may include judgment conditions on any one dimension of information. The relationship between the judgment conditions of different dimension information in the preset layout conditions may be an "and" relationship or an "or" relationship, and the embodiments of the present application do not impose too many restrictions on this.
[0363] In one possible application scenario, when a user is viewing a file of a preset document type, writing code, or browsing the web on a first device, the content on the display interface generally consists of text and a white background. The first device can use the display interface of the first device as the target screen content and project it onto a second device. The second device can then detect whether the current screen content meets the first eye protection condition and, upon detecting that the current screen content meets the first eye protection condition, generate eye protection content corresponding to the current screen content for display.
[0364] In one possible implementation, after receiving the first display information, the second device can obtain the target projection content. As shown in (a) in Figure 5B, the second device can display the target projection content. The second device can detect whether the target projection content meets the first eye protection condition. As shown in (b) in Figure 5B, the second device can respond to detecting that the target projection content meets the eye protection condition and display the eye protection function button on the current display interface. The second device can respond to detecting the user's triggering operation on the eye protection function button, generate the first eye protection content corresponding to the target projection content, and display the first eye protection content, as shown in (c) in Figure 5B.
[0365] In another possible design, according to the above introduction, the target screen content is part or all of the content of the target object. The second device can obtain the target screen content through the first display information. The second device can detect whether the target screen content is the content of the preset type of object. In response to detecting that the target screen content is the content of the preset type of object, the second device generates the first eye protection content according to the first display information.
[0366] Preset objects can be preconfigured. Preset objects can include, but are not limited to, any of the following types: file processing type, browser type, code editing type, video playback type, and video processing type. File processing types can include processing any of the following document types: PPT type, Word type, TXT type, PDF type, and Excel type.
[0367] For example, the second device can identify whether the target screen projection content contains an identifier of an object of a preset type, such as a text identifier or a picture identifier, based on image recognition technology. The text identifier can be the name of the object or the abbreviation of the name, and the picture identifier can be a thumbnail or logo of the object. If the second device recognizes that the target screen projection content contains an identifier of an object of a preset type, it can be determined that the target screen projection content is detected to be content of an object of the preset type. If the second device recognizes that the target screen projection content does not contain an identifier of an object of the preset type, it can be determined that the target screen projection content is not detected to be content of an object of the preset type.
[0368] For another example, when the first device detects that the target projection content is content in an object of a preset type, it can send the type information of the object to which the target projection content belongs to the second device. The second device can detect whether the type information of the object to which the received target projection content belongs is a preset type, thereby detecting whether the target projection content is content in an object of a preset type. The second device can detect whether the type information of the object to which the received target projection content belongs is a type in a preset type, thereby detecting that the target projection content is content in an object of a preset type.
[0369] In another possible design, the second device can generate first eye protection content corresponding to the target projection content according to the first display information in response to detecting that the ambient light parameters meet the second eye protection condition.
[0370] In some examples, the second device may have a sensor for collecting ambient light parameters. The first device projects the target projection content onto the scene of the second device, and the second device may collect the current ambient light parameters. In other examples, the first device may have a sensor for collecting ambient light parameters. The second device may obtain the current ambient light parameters from the first device. Alternatively, the first device may collect the current ambient light parameters and send them to the second device.
[0371] The second device can detect whether the current ambient light parameter meets the second eye protection condition. The second eye protection condition can be: the ambient light parameter is less than or equal to the ambient light threshold parameter. The second device can generate the first eye protection content corresponding to the target projection content according to the first display information when detecting that the current ambient light parameter is less than or equal to the ambient light threshold parameter. If the ambient light parameter is less than or equal to the ambient light threshold parameter, it can reflect that the current environment is relatively dim and it is necessary to provide the user with content with eye protection effect. If the ambient light parameter is greater than the ambient light threshold parameter, it can reflect that the current environment is relatively bright and it is not necessary to provide the user with content with eye protection effect.
[0372] In the screen projection display system of any of the above embodiments, when the second device generates the first eye protection content according to the first display information, the second device may perform the following process:
[0373] The second device can identify the background area in the target projection content;
[0374] The second device can generate first eye protection content based on the background area.
[0375] In an embodiment of the present application, the second device can obtain the target projection content based on the first display information. As shown in Figure 6A, the second device can generally include a background image for the target projection content. Elements such as text and pictures are suspended on the background image for presentation. In actual application scenarios, the background image can be a pure white image. Or the background image is a color image. Or the background image is a black and white image. The background area of the target projection content can be implemented as the area where the background image is located. Or the background area of the target projection content may include one or more of the following areas: the area where the text elements are located, the area where the picture elements are located, the aforementioned blank area, the area that does not contain text elements, the area that does not contain picture elements, and the area that does not contain text elements and does not contain picture elements.
[0376] In some examples, the second device can use a recognition model to identify the background area in the target projection content, and the aforementioned recognition model can be pre-trained.
[0377] In some other examples, the second device identifies a target element in the target projection content. The second device determines a background area in the target projection content based on the detected target element. Optionally, the second device may determine an area in the target projection content that does not contain text elements and does not contain image elements as the background area.
[0378] The elements detected by the second device may include a first element whose element type is a text type, or a second element whose element type is a picture type. In this embodiment, the second device may have a text recognition function and a picture recognition function. Optionally, the second device may adopt any text recognition technology to identify text elements in the target projection content. Optionally, the second device may adopt any picture recognition technology to identify picture elements in the target projection content.
[0379] In some examples, the second device can recognize text in document scenarios based on a convolutional recurrent neural network (CRNN) text recognition method. This model is primarily used to address the image sequence recognition problem in scene text recognition and can achieve end-to-end recognition of entire lines of text without the need for character segmentation. The CRNN model has a small number of parameters, making it suitable for use on devices with limited computing power.
[0380] The second device can first obtain the text location area. The area containing the text element is used as the detection target. A single-stage neural network prediction algorithm, YOLO (you only look once), is used to generate prediction boxes based on predefined candidate regions. The output vectors of each network corresponding to the input image are determined, ultimately resulting in the detected text location area. The second device can then employ an end-to-end CRNN algorithm to extract features, convert sequence information, and decode the text location area. Specifically, the model used can be a convolutional neural network (CNN) + recurrent neural network (RNN) + connectionist temporal classification (CTC) model. The CNN extracts image pixel features as a convolutional layer; the RNN extracts feature sequence information as a recurrent layer. A bidirectional RNN network, BiLSTM, is used to obtain the label distribution of the convolutional layer's feature sequence for prediction. The transcription layer is jointly trained using a CTC loss function. The label distribution obtained from the recurrent layer is decoded through operations such as deduplication and integration to produce the final recognition result, i.e., the elements of each text type.
[0381] In one possible design, when the second device generates the first eye protection content based on the background area, the second device may perform background eye protection processing on the background area to obtain a target optimized background image. The second device generates the first eye protection content based on the target optimized background image. The target optimized background image is an image obtained by performing background eye protection processing on an image in the background area.
[0382] Optionally, the background eye protection processing includes one or more of the following eye protection processing operations:
[0383] Set an image with a preset texture as the image in the target area;
[0384] adjusting the color of the image in the target area;
[0385] Performing grayscale processing on the image in the target area;
[0386] The target area is a partial area or the entire area of the background area.
[0387] The target area can be a partial area or the entire area of the background area. If the target area is a partial area of the background area, the images in the other areas of the background area except the target area may not be adjusted or processed. The target optimized background image corresponding to the background area is different from the original image of the background area. Optionally, the images in the other areas may be the same or different.
[0388] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0389] In some examples, for the background area in the target projection content, the second device can set an image with a preset texture as the image in the target area to obtain a target optimized background image corresponding to the background area, where the target area can be part or all of the background area.
[0390] In some examples, for the background area in the target projection content, the second device can adjust the color of the image in the target area to obtain the target optimized background image corresponding to the background area. For example, the second device can adjust the color of the image in the target area to the first color to obtain the target optimized background image corresponding to the background area. The color number of the first color can be configured according to the actual application scenario. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0391] If there are one or more target areas in the background area of the second device, the color of the image in each target area is adjusted to obtain a target optimized background image. For example, the second device can adjust the color of the image in the target area to the first color to obtain the target optimized background image.
[0392] In some examples, for the background area in the target projection content, the second device can perform grayscale processing on the image in the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area. Exemplarily, in the operation of the first device performing grayscale processing on the image in the target area, the first device can obtain the color parameters of each pixel of the image in the target area, wherein the color parameters include the value of the red channel, the value of the green channel, and the value of the blue channel. According to the preset grayscale algorithm and the color parameters of each pixel, the target grayscale value of each pixel is calculated. The first device can configure the value of each color channel in the color parameters of each pixel of the image in the target area as the target grayscale value corresponding to the pixel. Optionally, in the preset grayscale algorithm, the relationship between the target grayscale value Gray of a pixel and the color parameters (Red, Green, Blue) of the pixel can be: Gray = (Red*0.3+Green*0.59+Blue*0.11). Red represents the value of the red channel, Green represents the value of the green channel, and Blue represents the value of the blue channel.
[0393] In some other examples, the first device performs a first eye protection processing operation on the background area in the target projection content to obtain a target optimized background image corresponding to the background area; wherein, the first background eye protection processing operation may include: setting an image with a preset texture as the image in the target area, and then performing an operation to adjust the color of the image in the target area.
[0394] For example, the first device adjusts the background area of the target projection content by setting an image with a preset texture as the image in the target area and adjusting the color of the image in the target area to a first color, thereby obtaining a target optimized background image corresponding to the background area. The color number of the first color can be configured according to the actual application scenario. For example, the color number of the first color can be bcc1bd.
[0395] In other examples, the first device performs a second eye protection processing operation on the background area in the target projection content to obtain a target optimized background image corresponding to the background area; wherein, the second eye protection processing operation may include: setting an image with a preset texture as the image in the target area, and then adjusting the color of the image in the target area, and then performing grayscale processing on the image in the target area.
[0396] The second device can generate the first eye protection content based on the target optimized background image, as shown in Figure 6B. For example, the target optimized background image replaces the image in the background area of the target projection content to obtain the first eye protection content. In this way, the background of the target projection content is separated from the text elements or image elements, and the background is processed for eye protection, so that the background is soft or has a paper-like viewing effect.
[0397] In another possible design, when the second device generates the first eye protection content based on the background area, the second device may perform background eye protection processing on the background area to obtain a target optimized background image. The second device may perform quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element of a text type or a second element of a picture type. The second device generates the first eye protection content based on the target optimized background image and the optimized elements.
[0398] In this design, the process of the second device obtaining the target optimized background image can be referred to the relevant introduction in the aforementioned embodiment and will not be repeated here.
[0399] As shown in Figure 6C, the second device can replace the image in the background area of the target projection content with the target optimized background image, replace the text element with the optimized element of the text element, and replace the picture element with the optimized element of the picture element to form the first eye protection content.
[0400] In some examples, the second device can generate the first eye protection content based on the detected target element and the target optimized background image. The second device can also perform quality improvement processing on some or all of the target elements. In this example, the elements after quality improvement processing are recorded as optimized elements.
[0401] For example, the second device may perform quality improvement processing on each first element in the target element to obtain an optimized element corresponding to each first element.
[0402] Optionally, the quality improvement processing for text-type elements may include but is not limited to any of the following text enhancement processing: text color enhancement processing; text edge bolding processing.
[0403] For another example, the second device may perform quality improvement processing on each second element in the target element to obtain an optimized element corresponding to each second element.
[0404] Optionally, quality enhancement processing is performed on image elements, including but not limited to image color enhancement processing. Image color enhancement processing may include but is not limited to any of the following color enhancement processing: denoising; adjusting image saturation; adjusting image color temperature; adjusting image contrast; edge enhancement; dark light enhancement; and image super-resolution processing.
[0405] For another example, the second device may perform quality improvement processing on each element in the target element to obtain an optimized element corresponding to each element. That is, the second device may obtain an optimized element corresponding to each first element and an optimized element corresponding to each second element in the target element.
[0406] In another possible design, the second device can generate the first eye protection content based on the detected elements and the target eye protection mode parameters.
[0407] The second device may be pre-configured with multiple eye protection modes, each of which may be characterized by an eye protection mode parameter. The second device may generate eye protection content corresponding to the target projection content based on the eye protection mode parameter and a corresponding processing method for the eye protection mode parameter.
[0408] In some possible scenarios, the target eye protection mode parameters may be sent by the first device to the second device. For example, the first device may carry the target eye protection mode parameters in the first instruction sent by itself to the second device. As shown in (a) in Figure 7, the first floating window or the first menu for setting the eye protection mode may be displayed in the display interface of the first device. The first floating window or the first menu may display options for a variety of eye protection modes. The user can select an eye protection mode by selecting one of the multiple options. In this application, the eye protection mode selected by the user is recorded as the target eye protection mode. The first device may send the target eye protection mode parameters that characterize the target eye protection mode to the second device.
[0409] In other possible scenarios, the target eye protection mode parameters may be detected by the second device. For example, as shown in (b) of Figure 7, a second floating window or a second menu for setting the eye protection mode may be displayed in the display interface of the second device. The second floating window or the second menu may display options for multiple eye protection modes. The user can select an eye protection mode by selecting one of the multiple options. The second device may use the parameters corresponding to the eye protection mode selected by the user as the target eye protection mode parameters.
[0410] The second device generates eye protection content in different ways in different eye protection modes. In an embodiment of the present application, multiple eye protection modes may include but are not limited to the first eye protection mode, the second eye protection mode, and the third eye protection mode provided in this application. In some scenarios, the first eye protection mode can be called a paper-like color eye protection mode, the second eye protection mode can be called a paper-like black and white eye protection mode, and the third eye protection mode can be called a color eye protection mode.
[0411] In some examples, if the target eye protection mode parameter is the first eye protection mode parameter, that is, the second device is in the first eye protection mode, the second device executes the first generation method. The first generation method includes the following operations:
[0412] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0413] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0414] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0415] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0416] The second device generates the first eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The second device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the first eye protection content.
[0417] In some other examples, if the target eye protection mode parameter is the second eye protection mode parameter, that is, the second device is in the second eye protection mode, the second device executes the second generation method, where the second generation method includes the following operations:
[0418] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0419] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0420] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0421] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0422] The second device performs grayscale processing on the content to be processed to generate the first eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the second device can first generate the content to be processed, and the second device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The second device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. The second device can then perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the first eye protection content.
[0423] Exemplarily, the second device can obtain the color parameters of each pixel of the content to be processed, wherein the color parameters include the value of the red channel, the value of the green channel, and the value of the blue channel. According to the preset grayscale algorithm and the color parameters of each pixel, the target grayscale value of each pixel is calculated. The second device can configure the value of each color channel in the color parameters of each pixel of the content to be processed as the target grayscale value corresponding to the pixel. Optionally, in the preset grayscale algorithm, the relationship between the target grayscale value Gray of a pixel and the color parameters (Red, Green, Blue) of the pixel can be: Gray = (Red*0.3+Green*0.59+Blue*0.11). Red represents the value of the red channel, Green represents the value of the green channel, and Blue represents the value of the blue channel.
[0424] In some other examples, if the target eye protection mode parameter is a third eye protection mode parameter, that is, the second device is in the third eye protection mode, the second device executes a third generation method, where the third generation method includes the following operations:
[0425] The second device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The second device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain a second optimized image element corresponding to the target second element. Optionally, the second device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0426] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0427] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0428] If the target area exists in the background area, the second device can adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The second device generates the first eye protection content based on the second optimized picture element and the target optimized background image.
[0429] If the target area does not exist in the background area, the second device may generate the first eye protection content according to the second optimized picture element.
[0430] In the projection display system based on any of the above embodiments, in the operation of the second device generating the first eye protection content according to the first display information, the second device can perform the following process: the second device can identify the target element in the target projection content; the second device can generate the first eye protection content based on the detected target element. For example, the second device can enhance part or all of the elements in the target element based on the detected target element to obtain the optimized element corresponding to the target element, and then generate the first eye protection content based on the optimized element. For example, the second device can replace the target element in the target projection content with the optimized element corresponding to each target element, thereby generating the first eye protection content.
[0431] The target elements may include text elements, image elements, table elements, and icon elements. The process of determining the optimization elements corresponding to each element can be referred to the relevant introduction in the above embodiment and will not be repeated here.
[0432] The present invention provides a screen projection and display system in which a first device generates eye-protection content corresponding to target projection content. This eye-protection content can improve viewing quality and alleviate visual fatigue. The first device then projects this eye-protection content onto a second device, which then displays the eye-protection content.
[0433] Figure 8 shows a schematic diagram of the working process of a screen projection display system provided by an embodiment of the present application. In the screen projection display system, the first device can project part or all of the content of the target object onto the second device. Optionally, the first device can have a screen projection function, which can project the file selected by the user onto the second device. Alternatively, the first device has a screen projection application, and after the screen projection application is run, it can project the object selected by the user onto the second device.
[0434] The first device projects the target object onto the second device. In eye protection mode, the first device can project part or all of the target object's content onto the second device. The first device can display or not display the target object's content.
[0435] In an embodiment of the present application, the target projection content may refer to part or all of the content in the target object. Alternatively, the target projection content may refer to the content being viewed in the projection scene. Optionally, the target projection content may be the content currently being displayed on the first device, as shown in (a) of FIG8 .
[0436] The first device can project the second eye protection content corresponding to the target projection content to the second device. The first device can generate the eye protection content corresponding to the target projection content based on the target projection content. For easy distinction, the eye protection content corresponding to the target projection content generated by the first device is recorded as the second eye protection content.
[0437] The first device can generate display information of the second eye protection content, record it as the second display information for easy identification, and send the second display information to the second device. The second device can display the second eye protection content based on the second display information, that is, the eye protection content corresponding to the target projection content generated by the first device. As shown in (b) of Figure 8, the second eye protection content is displayed on the second device.
[0438] Optionally, the user can open the target projection content on the first device, and the preset display area of the first device can display the target projection content. After the first device generates the second eye protection content, the second eye protection content can be displayed in the display area. The first device records and encodes the display area to obtain video stream data, so that the first device generates display information of the second eye protection content. The first device can send the video stream data to the second device. The second device can decode the video stream data to obtain the second eye protection content.
[0439] In one possible design, the first device may be provided with a plurality of projection display modes, and the plurality of projection display modes may include a normal display mode and an eye protection display mode. When the first device operates in the normal display mode, the first device may obtain the target projection content; the first device may generate first display information of the target projection content and send it to the second device so that the second device displays the target projection content. When the first device operates in the eye protection display mode, the first device may obtain the target projection content and, based on the target projection content, generate second eye protection content corresponding to the target projection content. The first device sends the second display information corresponding to the second eye protection content to the second device so that the second device displays the second eye protection content.
[0440] Optionally, after the first device is powered on, it can run in the eye protection display mode by default, generate eye protection content corresponding to the corresponding content, and send the display information of the eye protection content to the second device. When the first device detects that the projection display mode is adjusted to the normal display mode, the first device can switch to run in the normal display mode. Alternatively, after the first device is powered on, it can run in the normal display mode by default. When the first device detects that the projection display mode is adjusted to the eye protection display mode, the first device can switch to run in the eye protection display mode.
[0441] In another possible design, the first device responds to the second instruction and generates second eye protection content corresponding to the target projection content based on the target projection content.
[0442] In some examples, the second instruction may be generated on the second device. For example, the second device may generate the second instruction in response to detecting the first target operation and send the second instruction to the first device. The first target operation may be understood as an operation performed by the user on the second device. Optionally, the first target operation may include, but is not limited to, any of the following operations:
[0443] a first operation of the user on the input device of the second device;
[0444] a second operation performed by the user on a virtual key displayed by the second device;
[0445] a third operation of the user on the touch display device of the second device;
[0446] Preset voice control operations;
[0447] Preset gesture control operations.
[0448] Among them, the implementation method of the first target operation in this example can be found in the relevant introduction of the aforementioned embodiment, and will not be repeated here.
[0449] In other examples, the second instruction may be generated on the first device. The first device may generate the second instruction in response to detecting a second target operation. The second target operation is any of the following operations:
[0450] a fourth operation of the user on the input device of the first device;
[0451] a fifth operation performed by the user on the virtual key displayed on the first device;
[0452] a sixth operation performed by the user on the touch display device of the first device;
[0453] Preset voice control operations;
[0454] Preset gesture control operations.
[0455] Among them, the implementation method of the second target operation in this example can be found in the relevant introduction of the aforementioned embodiment, and will not be repeated here.
[0456] In some possible scenarios, as shown in FIG4C , the first device detects a fifth operation performed by the user on a virtual key for the eye protection function displayed on the first device, which may trigger the first device to generate a second instruction. Optionally, the user may perform the fifth operation on the virtual key through a command input device. The command input device may include, but is not limited to, an input device such as a mouse, keyboard, touch screen, remote control, or a writing pen. The fifth operation may include, but is not limited to: clicking a virtual key once, clicking a virtual key continuously, or long pressing a virtual key for a preset time.
[0457] In some implementations, the first device may display a virtual button for the eye protection function when it detects that the target projection content is content in an object of a preset type. The object of the preset type may be pre-configured. The object of the preset type may include, but is not limited to, any of the following types of objects: file processing type objects, browser type, code editing type, video playback type, and video processing type objects. Among them, the object of the file processing type may include an object that processes any of the following document types: ppt type, word type, txt type, pdf type, and excel type.
[0458] For example, the first device can identify whether the target screen projection content contains an identifier of an object of a preset type, such as a text identifier or a picture identifier, based on image recognition technology. The text identifier can be the name of the object or the abbreviation of the name, and the picture identifier can be a thumbnail or logo of the object. If the first device recognizes that the target screen projection content contains an identifier of an object of a preset type, it can be determined that the target screen projection content is detected to be content of an object of the preset type. If the first device recognizes that the target screen projection content does not contain an identifier of an object of the preset type, it can be determined that the target screen projection content is not detected to be content of an object of the preset type.
[0459] For another example, the first device can detect whether the application package name of the foreground running object is the application package name of an object of a preset type, thereby detecting the file type of the running object. For example, the first device can detect whether the application package name of the target object to which the target screen projection content belongs is the application package name of an object of a preset type, thereby detecting whether the target screen projection content is content in an object of a preset type. If the first device detects that the application package name of the target object to which the target screen projection content belongs is consistent with the application package name of an object of a preset type, then it is detected that the target screen projection content is content in an object of a preset type.
[0460] For another example, the first device can identify whether the target projection content contains an identifier of a preset type of object, such as a text identifier or a picture identifier, based on image recognition technology.
[0461] In other implementations, the second device can detect whether the target screen projection content is the content of an object of a preset type, and send the type information of the target object to which the target screen projection content belongs to the first device. The first device can display the virtual button of the eye protection function based on the type information of the target object to which the target screen projection content belongs being the preset type. Alternatively, the second device can identify whether the target screen projection content is a document, and send the identified document type information to the first device, so that the first device can display the virtual button of the eye protection function based on the information that the received file type information is the preset file type.
[0462] In another possible design, the first device obtains the target screen projection content. The first device can detect whether the target screen projection content meets the first eye protection condition. In response to detecting that the target screen projection content meets the first eye protection condition, the first device can generate second eye protection content corresponding to the target screen projection content. Optionally, the first eye protection condition may include one or more of the following conditions:
[0463] Condition 1: The ratio of the sum of the number of pixels of all text-type elements in the target projection content to the total number of pixels of the target projection content is greater than or equal to the first pixel ratio threshold. Optionally, the first pixel ratio threshold can be configured as 10%.
[0464] Condition 2: There is a blank area in the target projection content, and the number of pixels in at least one blank area is greater than or equal to the second pixel ratio threshold. Optionally, the second pixel ratio threshold can be configured as 40%.
[0465] Condition 3: There is blank area in the target projection content.
[0466] Condition 4: The layout of the target projection content meets the preset layout conditions.
[0467] The first device may pre-store the number of pixels corresponding to text type elements of various font sizes at different projection resolutions. Thus, the first device can determine the total number of pixels of all text type elements in the target projection content. For example, the projection resolution is 1920*1080, and the number of pixels of text (or characters) in font size 3 is 20px. Among them, the projection resolution may refer to the resolution of the projection device. That is, the display resolution of the second device. In the projection scenario, a connection can be established between the first device and the second device by means of a handshake. During this process, the second device can send its own resolution to the first device so that the first device can know the second device. Optionally, the first device can generate the second eye protection content corresponding to the target projection content according to the projection resolution of the second device. Or the first device can generate the second eye protection content corresponding to the target projection content according to the display resolution of the first device.
[0468] The blank area can be determined in this way. The first device can extract the feature values of the screen image when the target projection content is normally displayed, and perform color segmentation by clustering. In this way, multiple color areas can be obtained. Among them, the color area with the target color can be determined as the blank area. Among them, the target color can be a color of a pre-set first color number, or the target color can be the color of any one of a plurality of pre-set first color numbers.
[0469] The first device can determine the number of pixels in the blank area based on the area of the blank area and the size (area) of one pixel. The first device can determine the number of pixels in the target projection content based on the area of the display range where the target projection content is located and the size (area) of one pixel.
[0470] The layout of the target projection content may include information of one or more dimensions. For example, information of the position dimension: the position of text elements, the position of picture elements, and the relative position relationship between text elements and picture elements. Information of the pixel number dimension: the number of pixels of text elements, the number of pixels of picture elements. For another example, information of the scale dimension, the ratio of the total pixels of text elements to the total pixels of target projection content, and the ratio of the total pixels of picture elements to the total pixels of target projection content. Among them, the preset layout conditions may include judgment conditions on any one dimension of information. The relationship between the judgment conditions of different dimension information in the preset layout conditions may be an "and" relationship or an "or" relationship, and the embodiments of the present application do not impose too many restrictions on this.
[0471] In one possible application scenario, a user is writing code or browsing the web on a first device, where the content displayed on the screen generally consists of text and a white background. The first device can detect whether the currently displayed content meets the first eye protection condition. Upon detecting that the currently displayed content meets the first eye protection condition, the first device can generate second eye protection content corresponding to the currently displayed content and project the second eye protection content onto the second device for display.
[0472] In one possible implementation, the first device can obtain the target projection content. As shown in (a) of Figure 9, the first device can display the target projection content. The first device can detect whether the target projection content meets the first eye protection condition. As shown in (b) of Figure 9, the first device can display the eye protection function button on the current display interface in response to detecting that the target projection content meets the first eye protection condition. The first device can generate second eye protection content corresponding to the target projection content in response to detecting the user triggering the eye protection function button. Optionally, the first device sends the second display information of the second eye protection content to the second device, and the second device displays the second eye protection content according to the second display information as shown in (c) of Figure 9.
[0473] In another possible design, the first device can obtain the target object. According to the above introduction, the target projection content is part or all of the content of the target object. The first device can detect whether the target projection content is the content of a preset type of object. In response to detecting that the target projection content is the content of an object of a preset type, the first device generates the second eye protection content according to the target projection content.
[0474] Preset objects can be preconfigured. Preset objects can include, but are not limited to, any of the following types: file processing type, browser type, code editing type, video playback type, and video processing type. File processing types can include processing any of the following document types: PPT type, Word type, TXT type, PDF type, and Excel type.
[0475] For example, the first device can identify whether the target screen projection content contains an identifier of an object of a preset type, such as a text identifier or a picture identifier, based on image recognition technology. The text identifier can be the name of the object or the abbreviation of the name, and the picture identifier can be a thumbnail or logo of the object. If the first device recognizes that the target screen projection content contains an identifier of an object of a preset type, it can be determined that the target screen projection content is detected to be content of an object of the preset type. If the first device recognizes that the target screen projection content does not contain an identifier of an object of the preset type, it can be determined that the target screen projection content is not detected to be content of an object of the preset type.
[0476] For another example, the first device can detect whether the application package name of the foreground running object is the application package name of an object of a preset type, thereby detecting the file type of the running object. For example, the first device can detect whether the application package name of the target object to which the target screen projection content belongs is the application package name of an object of a preset type, thereby detecting whether the target screen projection content is content in an object of a preset type. If the first device detects that the application package name of the target object to which the target screen projection content belongs is consistent with the application package name of an object of a preset type, then it is detected that the target screen projection content is content in an object of a preset type.
[0477] For another example, when the second device detects that the target screen projection content is content in an object of a preset type, it sends the type information of the object to which the target screen projection content belongs to the first device. The first device can detect whether the type information of the object to which the received target screen projection content belongs is a preset type, thereby detecting whether the target screen projection content is content in an object of a preset type. The first device can detect that the type information of the object to which the received target screen projection content belongs is a type in a preset type, thereby detecting that the target screen projection content is content in an object of a preset type.
[0478] In another possible design, the first device can generate second eye protection content corresponding to the target projection content based on the target projection content in response to detecting that the ambient light parameters meet the second eye protection condition.
[0479] In some examples, the first device may have a sensor for collecting ambient light parameters. The first device projects the target projection content into the scene of the first device, and the first device may collect the current ambient light parameters. In other examples, the first device may be connected to a sensor for collecting ambient light parameters. The first device may obtain the current ambient light parameters from the sensor. Alternatively, the sensor may collect the current ambient light parameters and send them to the first device.
[0480] The first device can detect whether the current ambient light parameter meets the second eye protection condition. The second eye protection condition can be: the ambient light parameter is less than or equal to the ambient light threshold parameter. The first device can generate the second eye protection content corresponding to the target projection content according to the target projection content when detecting that the current ambient light parameter is less than or equal to the ambient light threshold parameter. If the ambient light parameter is less than or equal to the ambient light threshold parameter, it can reflect that the current environment is relatively dim and it is necessary to provide the user with content with eye protection effect. If the ambient light parameter is greater than the ambient light threshold parameter, it can reflect that the current environment is relatively bright and it is not necessary to provide the user with content with eye protection effect.
[0481] In the screen projection display system according to any of the above embodiments, when the first device generates the second eye protection content according to the target screen projection content, the first device may perform the following process:
[0482] The first device can identify a background area in the target projection content;
[0483] The first device can generate second eye protection content based on the background area.
[0484] As shown in Figure 6A, the first device can generally include a background image for the target projection content. Elements such as text and pictures are suspended on the background image for presentation. In actual application scenarios, the background image can be a pure white image. Or the background image is a color image. Or the background image is a black and white image. The background area of the target projection content can be implemented as the area where the background image is located. Or the background area of the target projection content can include one or more of the following areas: the area where the text elements are located, the area where the picture elements are located, the aforementioned blank area, the area that does not contain text elements, the area that does not contain picture elements, and the area that does not contain text elements and does not contain picture elements.
[0485] In some examples, the first device can use a recognition model to identify the background area in the target projection content, and the aforementioned recognition model can be pre-trained.
[0486] In some other examples, the first device identifies a target element in the target projection content. The first device determines a background area in the target projection content based on the detected target element. Optionally, the first device may determine an area in the target projection content that does not contain text elements and does not contain image elements as the background area.
[0487] The elements detected by the first device may include a first element whose element type is a text type, or a second element whose element type is a picture type. In this embodiment, the first device may have a text recognition function and a picture recognition function. Optionally, the first device may adopt any text recognition technology to identify text elements in the target projection content. Optionally, the first device may adopt any picture recognition technology to identify picture elements in the target projection content.
[0488] In some examples, the first device can recognize text in a document scenario based on a text recognition method using a convolutional recurrent neural network (CRNN). This model is primarily used to address the image sequence recognition problem in scene text recognition and can achieve end-to-end recognition of entire lines of text without the need for character segmentation. The CRNN model has a small number of parameters, making it suitable for use on devices with limited computing power.
[0489] The first device can first obtain the text location region. The region containing the text element is used as the detection target. A single-stage neural network prediction algorithm, YOLO (you only look once), is used to generate prediction boxes based on predefined candidate regions for annotation. The output vectors of each network corresponding to the input image are determined, ultimately resulting in the detected text location region. The first device can then employ an end-to-end CRNN algorithm to extract features, convert sequence information, and decode the text location region. Specifically, the model used can be a convolutional neural network (CNN) + recurrent neural network (RNN) + connectionist temporal classification (CTC) model. The CNN extracts image pixel features as a convolutional layer; the RNN extracts feature sequence information as a recurrent layer. A bidirectional RNN network, BiLSTM, is used to obtain the label distribution of the convolutional layer's feature sequence for prediction. The transcription layer is jointly trained using a CTC loss function. The label distribution obtained from the recurrent layer is decoded through operations such as deduplication and integration to produce the final recognition result, i.e., the elements of each text type.
[0490] In one possible design, when the first device generates the second eye protection content based on the background area, the first device may perform background eye protection processing on the background area to obtain a target optimized background image. The first device generates the second eye protection content based on the target optimized background image. The target optimized background image is an image obtained by performing background eye protection processing on an image in the background area.
[0491] Optionally, the background eye protection processing includes one or more of the following eye protection processing operations:
[0492] Set an image with a preset texture as the image in the target area;
[0493] adjusting the color of the image in the target area;
[0494] Performing grayscale processing on the image in the target area;
[0495] The target area is a partial area or the entire area of the background area.
[0496] The target area may be a partial area or the entire area of the background area. If the target area is a partial area of the background area, the images in the other areas of the background area except the target area may not be adjusted or processed. The target optimized background image corresponding to the background area is different from the original image of the background area. Optionally, the images in the other areas may be the same or different.
[0497] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0498] In some examples, for the background area in the target projection content, the first device can set an image with a preset texture as the image in the target area to obtain a target optimized background image corresponding to the background area, where the target area can be a partial area or the entire area in the background area.
[0499] In some examples, for the background area in the target projection content, the first device can adjust the color of the image in the target area to obtain the target optimized background image corresponding to the background area. For example, the first device can adjust the color of the image in the target area to the first color to obtain the target optimized background image corresponding to the background area. The color number of the first color can be configured according to the actual application scenario. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0500] If there are one or more target areas in the background area of the first device, the color of the image in each target area is adjusted to obtain a target optimized background image. For example, the first device can adjust the color number of the image in the target area to a first color to obtain the target optimized background image.
[0501] In some examples, for the background area in the target projection content, the first device can perform grayscale processing on the image in the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area. Exemplarily, in the operation of the first device performing grayscale processing on the image in the target area, the first device can obtain the color parameters of each pixel of the image in the target area, wherein the color parameters include the value of the red channel, the value of the green channel, and the value of the blue channel. According to the preset grayscale algorithm and the color parameters of each pixel, the target grayscale value of each pixel is calculated. The first device can configure the value of each color channel in the color parameters of each pixel of the image in the target area as the target grayscale value corresponding to the pixel. Optionally, in the preset grayscale algorithm, the relationship between the target grayscale value Gray of a pixel and the color parameters (Red, Green, Blue) of the pixel can be: Gray = (Red*0.3+Green*0.59+Blue*0.11). Red represents the value of the red channel, Green represents the value of the green channel, and Blue represents the value of the blue channel.
[0502] In some other examples, the first device performs a first eye protection processing operation on the background area in the target projection content to obtain a target optimized background image corresponding to the background area; wherein, the first background eye protection processing operation may include: setting an image with a preset texture as the image in the target area, and then performing an operation to adjust the color of the image in the target area.
[0503] For example, the first device adjusts the background area of the target projection content by setting an image with a preset texture as the image in the target area and adjusting the color of the image in the target area to a first color, thereby obtaining a target optimized background image corresponding to the background area. The color number of the first color can be configured according to the actual application scenario. For example, the color number of the first color can be bcc1bd.
[0504] In other examples, the first device performs a second eye protection processing operation on the background area in the target projection content to obtain a target optimized background image corresponding to the background area; wherein, the second eye protection processing operation may include: setting an image with a preset texture as the image in the target area, and then adjusting the color of the image in the target area, and then performing grayscale processing on the image in the target area.
[0505] The first device can generate the second eye protection content based on the target optimized background image, as shown in Figure 6B. For example, the target optimized background image replaces the image in the background area of the target projection content to obtain the second eye protection content. In this way, the background of the target projection content is separated from the text elements or image elements, and the background is processed for eye protection, so that the background is soft or has a paper-like viewing effect.
[0506] In another possible design, when the first device generates the second eye protection content based on the background area, the first device may perform background eye protection processing on the background area to obtain a target optimized background image. The first device may perform quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element of a text type or a second element of a picture type. The first device generates the second eye protection content based on the target optimized background image and the optimized elements.
[0507] In this design, the process of the first device obtaining the target optimized background image can be referred to the relevant introduction in the aforementioned embodiment and will not be repeated here.
[0508] As shown in Figure 6C, the first device can replace the image in the background area of the target projection content with the target optimized background image, replace the text element with the optimized element of the text element, and replace the picture element with the optimized element of the picture element to form the second eye protection content.
[0509] In some examples, the first device can generate the second eye protection content based on the detected target element and the target optimized background image. The first device can also perform quality improvement processing on some or all of the target elements. In this example, the elements after quality improvement processing are recorded as optimized elements.
[0510] For example, the first device may perform quality improvement processing on each first element in the target element to obtain an optimized element corresponding to each first element.
[0511] Optionally, the quality improvement processing for text-type elements may include but is not limited to any of the following text enhancement processing: text color enhancement processing; text edge bolding processing.
[0512] For another example, the first device may perform quality improvement processing on each second element in the target element to obtain an optimized element corresponding to each second element.
[0513] Optionally, quality enhancement processing is performed on image elements, including but not limited to image color enhancement processing. Image color enhancement processing may include but is not limited to any of the following color enhancement processing: denoising; adjusting image saturation; adjusting image color temperature; adjusting image contrast; edge enhancement; dark light enhancement; and image super-resolution processing.
[0514] For another example, the first device may perform quality improvement processing on each element in the target element to obtain an optimized element corresponding to each element. That is, the first device may obtain an optimized element corresponding to each first element and an optimized element corresponding to each second element in the target element.
[0515] In another possible design, the first device may generate second eye protection content based on the detected elements and target eye protection mode parameters.
[0516] The first device may be pre-configured with multiple eye protection modes, each of which may be characterized by an eye protection mode parameter. The first device may generate eye protection content corresponding to the target projection content based on the eye protection mode parameter and a processing method corresponding to the eye protection mode parameter.
[0517] In some possible scenarios, the target eye protection mode parameters may be sent by the first device to the first device. For example, the first device may carry the target eye protection mode parameters in the first instruction sent by itself to the first device. As shown in (a) in Figure 7, the first floating window or the first menu for setting the eye protection mode may be displayed in the display interface of the first device. The first floating window or the first menu may display options for a variety of eye protection modes. The user can select an eye protection mode by selecting one of the multiple options. In this application, the eye protection mode selected by the user is recorded as the target eye protection mode. The first device may send the target eye protection mode parameters that characterize the target eye protection mode to the first device.
[0518] In other possible scenarios, the target eye protection mode parameters may be detected by the first device. For example, as shown in (b) in Figure 7, a second floating window or a second menu for setting the eye protection mode may be displayed in the display interface of the first device. The second floating window or the second menu may display options for a variety of eye protection modes. The user can select an eye protection mode by selecting one of the multiple options. The first device may use the parameters corresponding to the eye protection mode selected by the user as the target eye protection mode parameters.
[0519] The first device generates eye protection content in different ways in different eye protection modes. In an embodiment of the present application, multiple eye protection modes may include but are not limited to the first eye protection mode, the second eye protection mode, and the third eye protection mode provided in this application. In some scenarios, the first eye protection mode can be called a paper-like color eye protection mode, the second eye protection mode can be called a paper-like black and white eye protection mode, and the third eye protection mode can be called a color eye protection mode.
[0520] In some examples, if the target eye protection mode parameter is a first eye protection mode parameter, that is, the first device is in the first eye protection mode, the first device executes a first generation method, wherein the first generation method includes the following operations:
[0521] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0522] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0523] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0524] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0525] The first device generates the second eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The first device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the second eye protection content.
[0526] In some other examples, if the target eye protection mode parameter is the second eye protection mode parameter, that is, the first device is in the second eye protection mode, the first device executes the second generation method, where the second generation method includes the following operations:
[0527] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0528] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0529] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0530] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0531] The first device performs grayscale processing on the content to be processed to generate the second eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the first device can first generate the content to be processed, and the first device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The first device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. Then the first device can perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the second eye protection content.
[0532] Exemplarily, the first device can obtain the color parameters of each pixel of the content to be processed, where the color parameters include the value of the red channel, the value of the green channel, and the value of the blue channel. According to the preset grayscale algorithm and the color parameters of each pixel, the target grayscale value of each pixel is calculated. The first device can configure the value of each color channel in the color parameters of each pixel of the content to be processed as the target grayscale value corresponding to the pixel. Optionally, in the preset grayscale algorithm, the relationship between the target grayscale value Gray of a pixel and the color parameters (Red, Green, Blue) of the pixel can be: Gray = (Red*0.3+Green*0.59+Blue*0.11). Red represents the value of the red channel, Green represents the value of the green channel, and Blue represents the value of the blue channel.
[0533] In some other examples, if the target eye protection mode parameter is a third eye protection mode parameter, that is, the first device is in the third eye protection mode, the first device executes a third generation method, where the third generation method includes the following operations:
[0534] The first device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in the said all or part of the second elements. Optionally, the first device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The first device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain the second optimized image element corresponding to the target second element. Optionally, the first device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0535] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0536] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0537] If the target area exists in the background area, the first device may adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The first device generates the second eye protection content based on the second optimized picture element and the target optimized background image.
[0538] If the target area does not exist in the background area, the first device may generate the second eye protection content according to the second optimized picture element.
[0539] In the projection display system based on any one of the above embodiments, in the operation of the first device generating the second eye protection content according to the target projection content, the first device can perform the following process: the first device can identify the target element in the target projection content; the first device can generate the second eye protection content based on the detected target element. For example, the first device can enhance part or all of the elements in the target element based on the detected target element, obtain the optimized element corresponding to the target element, and then generate the second eye protection content based on the optimized element. For example, the first device can replace the target element in the target projection content with the optimized element corresponding to each target element, thereby generating the second eye protection content.
[0540] The target elements may include text elements, image elements, table elements, and icon elements. The process of determining the optimization elements corresponding to each element can be referred to the relevant introduction in the above embodiment and will not be repeated here.
[0541] Figure 10 shows a schematic diagram of the working process of a screen projection display system provided by an embodiment of the present application. In the screen projection display system, the first device can project part or all of the content of the target object onto the second device. Optionally, the first device can have a screen projection function, which can project the file selected by the user onto the second device. Alternatively, the first device has a screen projection application, and after the screen projection application is run, it can project the object selected by the user onto the second device.
[0542] Among them, the first device projects the target object into the second device scene, and the first device can project part or all of the content in the target object onto the second device in eye protection mode. The first device can display the content in the target object or not. In an embodiment of the present application, the target projection content may refer to part or all of the content in the target object. Optionally, the target projection content may be the content being displayed by the first device, as shown in (a) in Figure 10. The first device can project the target projection content to the second device. The first device can receive the first display information of the target projection content and send it to the second device. So that the second device can obtain the target projection content based on the first display information.
[0543] The second device obtains the target ambient light parameters. The second device determines the display parameters based on the target ambient light parameters, and the determined display parameters are recorded as target display parameters. The second device generates third eye protection content corresponding to the target projection content based on the target display parameters and the first display information. In an embodiment of the present application, the ambient light parameters can be parameters that characterize the ambient lighting conditions in the scene. Optionally, the ambient light parameters can be ambient light intensity. Or the ambient light parameters can be lighting types. Among them, the lighting types can include dim, normal, bright, and other types.
[0544] The first device projects the target projection content onto the scene on the second device, and the second device can obtain parameters representing the ambient lighting conditions in the current scene, recorded as target ambient light parameters. The second device can generate third eye protection content corresponding to the target projection content based on the target ambient light parameters. The second device can display the third eye protection content, as shown in (b) of Figure 10.
[0545] In one possible design, the second device may be configured with multiple sets of display parameters, or the second device may pre-store multiple sets of display parameters.
[0546] A set of display parameters may include one or more parameters of contrast, saturation, hue, picture quality (PQ), and color temperature. In other words, a set of display parameters may include at least one of the following parameters: contrast, saturation, hue, PQ, and color temperature.
[0547] For example, the display parameters may include contrast, saturation, hue, PQ, and color temperature; for example, the display parameters may include contrast; for example, the display parameters may include saturation; for example, the display parameters may include hue; for example, the display parameters may include PQ; for example, the display parameters may include color temperature; for example, the display parameters may include contrast, saturation; for example, the display parameters may include contrast, hue; for example, the display parameters may include contrast, PQ; for example, the display parameters may include contrast, color temperature; for example, the display parameters may include saturation, hue; for example, the display parameters may include saturation, PQ; for example, the display parameters may include saturation, color temperature; for example, the display parameters may include hue, PQ; for example, the display parameters may include hue, color temperature; for example, the display parameters may include For example, the display parameters may include contrast, saturation, and hue; for example, the display parameters may include contrast, saturation, and PQ; for example, the display parameters may include contrast, saturation, and color temperature; for example, the display parameters may include contrast, saturation, and PQ; for example, the display parameters may include contrast, saturation, and color temperature; for example, the display parameters may include contrast, PQ, and color temperature; for example, the display parameters may include saturation, hue, and PQ; for example, the display parameters may include saturation, hue, and color temperature; for example, the display parameters may include saturation, PQ, and color temperature; for example, the display parameters may include saturation, hue, and color temperature; for example, the display parameters may include contrast, saturation, hue, and color temperature; for example, the display parameters may include contrast, saturation, hue, and color temperature; for example, the display parameters may include contrast, saturation, hue, and color temperature; for example, the display parameters may include contrast, saturation, hue, and color temperature.
[0548] In some possible scenarios, the number of items (or quantity) of parameters in the display parameters of the second device can be configured according to the actual application scenario, and the embodiments of the present application do not specifically limit this.
[0549] The second device can determine the target group display parameters corresponding to the target ambient light parameters based on the correspondence between the preset ambient light parameters and multiple groups of display parameters. The second device adjusts the target projection content according to the various parameters in the target group display parameters to generate the third eye protection content. For example, the second device can adjust one or more parameters of the contrast, hue, PQ, saturation, and color temperature of the target content to generate the third eye protection content, that is, the adjusted target content can be used as the third eye protection content.
[0550] In some examples, the second device can display the third eye protection content. In other examples, the second device can determine a target screen brightness corresponding to the target ambient light parameter based on a preset correspondence between the ambient light parameter and the screen brightness; and the second device can display the third eye protection content according to the target screen brightness.
[0551] In a possible implementation, the ambient light parameter may be ambient light intensity.
[0552] In one possible design, the second device may pre-store correspondences between different ambient light parameters and multiple sets of display parameters.
[0553] The second device may be pre-configured with different ambient light sets and multiple sets of display parameters. Different ambient light sets correspond to different display parameters. Each ambient light set may include at least one ambient light parameter. Different ambient light sets may not have the same ambient light parameter. Therefore, one ambient light parameter belongs to one ambient light set.
[0554] Table 1 below shows different display parameters corresponding to different ambient light sets:
[0555] Table 1
[0556] In some application scenarios, the corresponding relationship between different ambient light sets and display parameters can be shown in Table 2:
[0557] Table 2
[0558] In some application scenarios, the correspondence between different ambient light sets and display parameters may be as shown in Table 3: wherein the display parameters include contrast, saturation, and hue.
[0559] Table 3
[0560] Table 3 also shows the corresponding relationship between the ambient light set and the screen brightness, and the screen brightness parameter represents the screen brightness value.
[0561] In some application scenarios, the correspondence between different ambient light sets and various display parameter groups can be as shown in Table 4. The display parameters include color temperature. Table 4 also shows the correspondence between different ambient light sets and screen brightness. The screen brightness parameter represents the screen brightness ratio. The maximum value within the display brightness range of the second device is generally designated as the maximum brightness value, denoted as LMAX.
[0562] Table 4
[0563] M1 can be any value between 50%*LMAX and 70%*LMAX, M4 can be any value between 3000K and 4000K; M2 can be any value between 70%*LMAX and 80%*LMAX, M5 can be 6500K; M31 can be any value between 80%*LMAX and 100%*LMAX, and M6 can be 6500K.
[0564] The second device can determine a set of display parameters corresponding to any ambient light parameter by combining the display parameters corresponding to each ambient light set. For example, the second device can determine the display parameters corresponding to the target ambient light set to which the target ambient light parameter belongs as the target set of display parameters corresponding to the target ambient light parameter.
[0565] The second device can use any numerical comparison method to determine the target ambient light set to which the target ambient light parameter belongs. For example, if an ambient light set y is [A, B), then determining whether any ambient light parameter x belongs to ambient light set y can be done by determining whether A≤x<B holds. If A≤x<B, the display parameter corresponding to ambient light set y is determined as the display parameter corresponding to ambient light parameter x.
[0566] In actual application scenarios, the second device may not have a specific form of ambient light set. Instead, it reflects an ambient light set through a numerical judgment condition. Each numerical judgment condition corresponds to a different display parameter. When any ambient light parameter x satisfies a numerical judgment condition, the display parameter corresponding to the numerical judgment condition is used as the display parameter corresponding to the ambient light parameter x.
[0567] Numerical judgment condition 1 can be used to judge whether A1≤x<B1 is established, and the reflected ambient light set is [A1, B1); if A1≤x<B1 is established, then the ambient light parameter x meets the numerical judgment condition 1; otherwise, if A1≤x<B1 is not established, then the ambient light parameter x does not meet the numerical judgment condition 1.
[0568] Similarly, numerical judgment condition 2 can be used to judge whether A2≤x<B2 is established, and the reflected ambient light set is [A2, B2); if A2≤x<B2 is established, then the ambient light parameter x meets numerical judgment condition 2; otherwise, if A2≤x<B2 is not established, then the ambient light parameter x does not meet numerical judgment condition 2.
[0569] In another possible design, the second device may determine the display parameter corresponding to any ambient light parameter based on a pre-configured algorithm of ambient light parameters and display parameters.
[0570] In some other possible implementations, the ambient light parameter may be an environment type. The second device may pre-store display parameters corresponding to each environment type. The second device may adjust the display screen of the second device according to the display parameters corresponding to the target ambient light parameter.
[0571] Table 5 below shows different display parameters corresponding to different environment types:
[0572] Table 5
[0573] In one possible implementation, the target ambient light parameter is sent by the first device to the second device. Optionally, the target ambient light parameter may be carried in a third instruction sent by the first device to the second device. The second device may adjust the display parameter based on the target ambient light parameter in response to the third instruction.
[0574] Optionally, the second device may periodically request ambient light parameters from the first device so that the second device may dynamically determine display parameters according to the latest ambient light parameters, thereby dynamically maintaining the eye protection effect.
[0575] The first device may include one or more light sensors that can collect ambient light parameters. Optionally, in response to detecting a second target operation, the first device may cause the light sensor of the first device to collect the ambient light parameters. The second target operation can be described in the aforementioned embodiments and will not be further described here.
[0576] In one possible design, the ambient light parameter may be ambient light intensity.
[0577] In some examples, the first device includes a light sensor, and the ambient light intensity collected by the light sensor is used as the target ambient light parameter. In other examples, the first device includes multiple light sensors, and the average of the ambient light intensities collected by the multiple light sensors is used as the target ambient light parameter.
[0578] In some further examples, the first device includes a light sensor. In response to detecting the second target operation, the first device may display a prompt for collecting ambient light intensity, prompting the user to rotate horizontally within the location of the second device according to the prompt. The light sensor of the first device may collect multiple ambient light intensities and use an average of the collected multiple ambient light intensities as the target ambient light parameter.
[0579] In another possible design, the ambient light parameter may be a lighting type. The first device may determine the lighting type based on the ambient light intensity and use the determined lighting type as the target ambient light parameter. The first device may determine the lighting type corresponding to any ambient light intensity based on a preconfigured correspondence between ambient light intensity and lighting type. Alternatively, the first device may determine the lighting type corresponding to any ambient light intensity based on a preset algorithm.
[0580] In some examples, the first device includes a light sensor, and the ambient light intensity collected by the light sensor is used as the current ambient light parameter. In other examples, the first device includes multiple light sensors, and the average of the ambient light intensities collected by the multiple light sensors is used as the current ambient light parameter.
[0581] In some further examples, the first device includes a light sensor. In response to detecting the second target operation, the first device may display a prompt for collecting ambient light intensity, prompting the user to rotate horizontally within the location where the second device is located according to the prompt. The light sensor of the first device may collect multiple ambient light intensities and use an average of the collected multiple ambient light intensities as the current ambient light parameter.
[0582] The first device determines the illumination type according to the current ambient light intensity as the target ambient light parameter.
[0583] In another possible implementation, the target ambient light parameter is collected by a second device. The second device may include one or more photosensors. In some examples, the second device includes a single photosensor, and the ambient light intensity collected by the photosensor is used as the target ambient light parameter. In other examples, the second device includes multiple photosensors, and the average of the ambient light intensities collected by the multiple photosensors is used as the target ambient light parameter.
[0584] On the other hand, an embodiment of the present application further provides a screen projection display method, including a first device and a second device, wherein the first device and the second device are communicatively connected, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal;
[0585] The first device obtains target ambient light parameters and target projection content;
[0586] The first device determines display parameters according to the target ambient light parameters;
[0587] The first device generates fourth eye protection content corresponding to the target projection content according to the display parameters and the first display information;
[0588] The first device sends third display information of the fourth eye protection content to the second device.
[0589] In this embodiment, the process of the first device determining the display parameters can refer to the process of the second device determining the display parameters. The process of the first device generating the fourth eye protection content corresponding to the target projection content based on the display parameters and the target projection content can refer to the process of the second device generating the third eye protection content corresponding to the target projection content.
[0590] In a possible implementation, the second device displays fourth eye protection content according to the third display information.
[0591] In one possible implementation, the second device obtains the target ambient light parameter; the second device determines the target screen brightness based on the target ambient light parameter; and the second device displays the fourth eye protection content based on the target screen brightness and the third display information.
[0592] In a possible implementation, the second device determines the target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness.
[0593] In one possible implementation, the second device receives a target screen brightness sent by the first device, and displays the fourth eye protection content based on the target screen brightness and the third display information.
[0594] Based on the first device and the second device provided in any of the above embodiments, as shown in FIG11A , the embodiment of the present application further provides a screen projection display method, which can be collaboratively performed by the first device and the second device. The method may include the following steps:
[0595] S1101A, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0596] S1102A, the second device generates first eye protection content corresponding to the target projection content based on the first display information.
[0597] S1103A: The second device displays the first eye protection content.
[0598] In a possible implementation, in step S1102A, the second device may generate first eye protection content corresponding to the target projection content according to the first display information in response to the first instruction.
[0599] In some examples, the second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations:
[0600] a first operation of the user on the input device of the second device;
[0601] a second operation performed by the user on a virtual key displayed by the second device;
[0602] a third operation of the user on the touch display device of the second device;
[0603] Preset voice control operations;
[0604] Preset gesture control operations.
[0605] In one possible implementation, in step S1102A, the second device generates first eye protection content corresponding to the target projection content according to the first display information in response to the first instruction; or
[0606] In response to detecting that the target projection content meets the first eye protection condition, the second device generates the first eye protection content according to the first display information; or
[0607] The second device generates the first eye protection content according to the first display information in response to detecting that the ambient light parameter meets the second eye protection condition, wherein the ambient light parameter is sent by the first device or collected by the second device; or
[0608] In response to detecting that the target projection content is content in an object of a preset type, the second device generates the first eye protection content according to the first display information.
[0609] As shown in FIG11B , an embodiment of the present application further provides a screen projection display method that can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0610] S1101B, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0611] S1102B: The first device sends a first instruction to the second device.
[0612] S1103B, the second device responds to the first instruction and generates first eye protection content corresponding to the target projection content according to the first display information.
[0613] S1104B: The second device displays the first eye protection content.
[0614] In step S1101B, when the first device detects a second target operation, it sends the first instruction to the second device; or, based on the target object being a file of a preset type, the first device sends the first instruction to the second device. The second target operation is any of the following:
[0615] a fourth operation of the user on the input device of the first device;
[0616] a fifth operation performed by the user on the virtual key displayed on the first device;
[0617] a sixth operation performed by the user on the touch display device of the first device;
[0618] Preset voice control operations;
[0619] Preset gesture control operations.
[0620] In step S1102A and step S1103B of the aforementioned embodiment, the second device generates the first eye protection content corresponding to the target projection content according to the first display information, and the following process may be performed:
[0621] The second device identifies a background area in the target projection content;
[0622] The second device generates the first eye protection content based on the background area.
[0623] In one possible design, the second device identifies a target element in the target projection content; and the second device determines a background area in the target projection content based on the detected target element.
[0624] In some examples, the second device performs background eye protection processing on the background area to obtain a target optimized background image;
[0625] The second device generates the first eye protection content based on the target optimized background image.
[0626] In some examples, the background eye protection processing includes one or more of the following processing operations:
[0627] Set an image with a preset texture as the image in the target area;
[0628] adjusting the color of the image in the target area;
[0629] Performing grayscale processing on the image in the target area;
[0630] The target area is a partial area or the entire area of the background area.
[0631] In another possible design, the second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0632] The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
[0633] As shown in FIG11C , the embodiment of the present application further provides a screen projection display method that can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0634] S1101C, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0635] S1102C: The first device sends a first instruction to the second device, where the first instruction carries target eye protection parameters.
[0636] S1103C: The second device responds to the first instruction and generates first eye protection content corresponding to the target projection content according to the first display information and the target eye protection parameters.
[0637] S1104C: The second device displays the first eye protection content.
[0638] In step S1103C, the second device generates first eye protection content corresponding to the target projection content according to the first display information and the target eye protection parameter, which may include:
[0639] The second device detects a target element in the target projection content;
[0640] The second device generates the first eye protection content based on the detected elements and the target eye protection mode parameters.
[0641] In one possible design, the second device generates the first eye protection content based on the detected elements and target eye protection mode parameters, including:
[0642] If the target eye protection mode parameter is the first eye protection mode parameter, the second device performs the following operations:
[0643] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0644] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0645] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0646] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0647] The second device generates the first eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The second device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the first eye protection content.
[0648] In one possible design, the second device generates the first eye protection content based on the detected elements and target eye protection mode parameters, including:
[0649] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0650] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0651] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0652] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0653] The second device performs grayscale processing on the content to be processed to generate the first eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the second device can first generate the content to be processed, and the second device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The second device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. The second device can then perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the first eye protection content.
[0654] In one possible design, the second device generates the first eye protection content based on the detected elements and target eye protection mode parameters, including:
[0655] If the target eye protection mode parameter is the third eye protection mode parameter, the second device performs the following operations:
[0656] The second device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The second device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain a second optimized image element corresponding to the target second element. Optionally, the second device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0657] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0658] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0659] If the target area exists in the background area, the second device can adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The second device generates the first eye protection content based on the second optimized picture element and the target optimized background image.
[0660] If the target area does not exist in the background area, the second device may generate the first eye protection content according to the second optimized picture element.
[0661] In the screen projection display method provided in Figures 11A, 11B, and 11C above, the sending device in the screen projection display system issues an AI eye protection command, and the receiving device performs eye protection adjustments on the projected screen. This makes interaction more convenient, and users can turn on eye protection mode at will. Moreover, even if the sending device operated by the user leaves the screen projection page, the receiving device can continue to display the projected screen and will not turn off eye protection mode.
[0662] Based on the screen projection display system provided by any of the above embodiments, as shown in Figure 12A, the embodiment of the present application also provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0663] S1201A: The first device obtains target projection content.
[0664] S1202A: The first device generates second eye protection content corresponding to the target projection content according to the target projection content;
[0665] S1203A: The first device sends second display information of the second eye protection content to the second device;
[0666] S1204A: The second device displays the second eye protection content according to the second display information.
[0667] In a possible implementation, in step S1202A, the first device may generate second eye protection content corresponding to the target projection content according to the target projection content in response to the second instruction.
[0668] In some examples, the first device generates the second instruction in response to detecting a second target operation; the second target operation is any one of the following operations:
[0669] a fourth operation of the user on the input device of the first device;
[0670] a fifth operation performed by the user on the virtual key displayed on the first device;
[0671] a sixth operation performed by the user on the touch display device of the first device;
[0672] Preset voice control operations;
[0673] Preset gesture control operations.
[0674] In one possible implementation, in step S1202A, the first device generates second eye protection content corresponding to the target projection content according to the target projection content in response to the second instruction; or
[0675] The first device generates second eye protection content corresponding to the target projection content based on the target object being a file of a preset type; or
[0676] The first device generates the second eye protection content in response to detecting that the target projection content meets the first eye protection condition; or
[0677] In response to detecting that the ambient light parameter meets the second eye protection condition, the first device generates the second eye protection content.
[0678] As shown in FIG12B , the embodiment of the present application further provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0679] S1201B, the first device obtains the target projection content.
[0680] S1202B: The second device sends a second instruction to the first device.
[0681] S1203B: The first device responds to the second instruction and generates second eye protection content corresponding to the target projection content based on the target projection content.
[0682] S1204B: The first device sends second display information of the second eye protection content to the second device.
[0683] S1205B: The second device displays the second eye protection content according to the second display information.
[0684] In step S1201B, when the second device detects a first target operation, it sends the second instruction to the first device; the first target operation is any one of the following operations:
[0685] a first operation of the user on the input device of the second device;
[0686] a second operation performed by the user on a virtual key displayed by the second device;
[0687] a third operation of the user on the touch display device of the second device;
[0688] Preset voice control operations;
[0689] Preset gesture control operations.
[0690] In step S1202A and step S1203B of the aforementioned embodiment, the first device generates the second eye protection content corresponding to the target projection content according to the target projection content, and the following process may be performed:
[0691] The first device identifies a background area in the target projection content;
[0692] The first device generates the second eye protection content based on the background area.
[0693] In one possible design, the first device identifies a target element in the target projection content; and the first device determines a background area in the target projection content based on the detected target element.
[0694] In some examples, the first device performs background eye protection processing on the background area to obtain a target optimized background image;
[0695] The first device generates the second eye protection content based on the target optimized background image.
[0696] In some examples, the background eye protection processing includes one or more of the following processing operations:
[0697] Set an image with a preset texture as the image in the target area;
[0698] adjusting the color of the image in the target area;
[0699] Performing grayscale processing on the image in the target area;
[0700] The target area is a partial area or the entire area of the background area.
[0701] In another possible design, the first device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0702] The first device optimizes the background image and the optimized elements according to the target to generate the second eye protection content.
[0703] As shown in FIG12C , the embodiment of the present application further provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0704] S1201C, the first device obtains the target projection content.
[0705] S1202C: The second device sends a second instruction to the first device, where the second instruction carries target eye protection parameters.
[0706] S1203C: The first device responds to the second instruction and generates second eye protection content corresponding to the target projection content according to the target eye protection parameters.
[0707] S1204C: The first device sends the second display information of the second eye protection content to the second device
[0708] S1205C: The second device displays the second eye protection content.
[0709] In step S1203C, the first device generates second eye protection content corresponding to the target projection content according to the target eye protection parameter, which may include:
[0710] The first device detects a target element in the target projection content;
[0711] The first device generates the second eye protection content based on the detected elements and the target eye protection mode parameters.
[0712] In one possible design, the first device generates the second eye protection content based on the detected elements and target eye protection mode parameters, including:
[0713] If the target eye protection mode parameter is the first eye protection mode parameter, the first device performs the following operations:
[0714] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0715] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0716] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0717] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0718] The first device generates the second eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The first device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the second eye protection content.
[0719] In one possible design, the first device generates the second eye protection content based on the detected elements and target eye protection mode parameters, including:
[0720] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0721] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0722] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0723] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0724] The first device performs grayscale processing on the content to be processed to generate the second eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the first device can first generate the content to be processed, and the first device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The first device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. Then the first device can perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the second eye protection content.
[0725] In one possible design, the first device generates the second eye protection content based on the detected elements and target eye protection mode parameters, including:
[0726] If the target eye protection mode parameter is the third eye protection mode parameter, the first device performs the following operations:
[0727] The first device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in the said all or part of the second elements. Optionally, the first device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The first device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain the second optimized image element corresponding to the target second element. Optionally, the first device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0728] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0729] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0730] If the target area exists in the background area, the first device may adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The first device generates the second eye protection content based on the second optimized picture element and the target optimized background image.
[0731] If the target area does not exist in the background area, the first device may generate the second eye protection content according to the second optimized picture element.
[0732] Based on the screen projection display system provided by any of the above embodiments, as shown in Figure 13A, the embodiment of the present application also provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0733] S1301A, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0734] S1302A: The second device obtains target ambient light parameters.
[0735] S1303A: The second device determines display parameters according to the target ambient light parameters.
[0736] S1304A: The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information;
[0737] S1305A: The second device displays the third eye protection content.
[0738] In one possible implementation, the set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature. In step S1303A, the second device determines the display parameters based on the target ambient light parameters, and may perform the following process:
[0739] The second device determines the target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters;
[0740] The second device adjusts the target projection content according to the parameters in the target group display parameters to generate the third eye protection content.
[0741] In a possible implementation, the target ambient light parameter is collected by the second device.
[0742] In a possible implementation manner, the target ambient light parameter is sent by the first device to the second device.
[0743] In a possible implementation, the second device determines a target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness;
[0744] The second device displays the third eye protection content according to the target screen brightness.
[0745] As shown in FIG13B , the embodiment of the present application further provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0746] S1301B, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0747] S1302B: The first device sends a third instruction to the second device, where the third instruction carries the target ambient light parameter.
[0748] S1303B: The second device determines display parameters according to the target ambient light parameters in response to the third instruction.
[0749] S1304B: The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information;
[0750] S1305B: The second device displays the third eye protection content.
[0751] Based on the screen projection display system provided by any of the above embodiments, as shown in Figure 14A, the embodiment of the present application also provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0752] S1401A: The first device obtains a target object and detects a file type of the target object.
[0753] S1402A, the first device identifies the target screen projection content in response to the eye protection screen projection instruction based on that the file type of the target object is a preset file type.
[0754] The target projection content may be part or all of the content of the target object. Optionally, the target projection content may be the content currently displayed on the first device.
[0755] S1403A, the first device generates second eye protection content corresponding to the target projection content.
[0756] The first device can identify the text, pictures, and blank areas in the target projection content. At this time, the first device can enhance the text and pictures. For the blank area, the first device adjusts the color of the blank area so that the blank area looks like paper. For example, the white background of the blank area can be changed to color number bcc1bd and the foreground color is 111111. Under this effect, it can have an eye protection effect.
[0757] S1404A: The first device sends second display information of the second eye protection content to the second device.
[0758] S1405A: The second device displays the second eye protection content according to the second display information.
[0759] Based on the screen projection display system provided by any of the above embodiments, as shown in Figure 14B, the embodiment of the present application also provides a screen projection display method, which can be collaboratively performed by the first device and the second device. The method may include the following steps:
[0760] S1401B: The first device detects whether the current display image meets the target scene.
[0761] The target scenario can be an application scenario such as viewing a file of a preset type, browsing a webpage, or writing code. The first device can detect whether the currently displayed screen meets the target scenario by detecting whether the currently displayed screen is content within an object of a preset type. The first device can determine whether the currently displayed screen meets the target scenario by detecting whether the currently displayed screen is content within an object of a preset type.
[0762] Preset objects can be preconfigured. Preset objects can include, but are not limited to, any of the following types: file processing type, browser type, code editing type, video playback type, and video processing type. File processing types can include processing any of the following document types: PPT type, Word type, TXT type, PDF type, and Excel type.
[0763] S1402B: The first device identifies the target projection content in response to the eye protection projection instruction based on that the current display screen complies with the target scene.
[0764] The target screen content may be part or all of the content of the target object opened by the first device. Optionally, the target screen content may be the content currently displayed by the first device.
[0765] S1403B: The first device generates second eye protection content corresponding to the target projection content.
[0766] In some examples, the first device can identify text and blank areas in the target projection content. At this time, the first device can enhance the text. The first device adjusts the color of the blank area so that the blank area looks like paper. For example, the white background of the blank area can be changed to color number bcc1bd and the foreground color is 111111. This effect can protect the eyes.
[0767] This method will modify large areas of white. Large areas of white background can be modified by extracting feature values from the current image and performing color segmentation through clustering. For white areas larger than 200px, their color can be changed to an eye-protection color. This change can identify the background as an eye-protection color, enhance the text, and make it look clearer.
[0768] S1404B: The first device sends second display information of the second eye protection content to the second device.
[0769] S1405B: The second device displays the second eye protection content based on the second display information.
[0770] Based on the screen projection display system provided by any of the above embodiments, as shown in Figure 14C, the embodiment of the present application also provides a screen projection display method, which can be collaboratively performed by a first device and a second device. The method may include the following steps:
[0771] S1401C: The first device interacts with the second device to determine a target device.
[0772] The first device and the second device can exchange the performance capabilities of their respective central processing units (CPUs) and graphics processing units (GPUs), and determine the device with the highest performance as the target device. The target device generates eye protection content.
[0773] In some examples, the target device may be the device with higher computing power between the first device and the second device.
[0774] In some possible application scenarios, in step S1401C, the target device is determined by the user.
[0775] S1402C: The target device generates target eye protection content corresponding to the target projection content.
[0776] S1403C: If the target device is the second device, the target device displays the target eye protection content.
[0777] S1404C: If the target device is the first device, the target device sends target display information corresponding to the target eye protection content to the second device.
[0778] S1405C: The second device displays the target eye protection content according to the target display information.
[0779] In one possible implementation, in step S1402C, the target device generates an image of the target projection content, which is recorded as the first image. Optionally, if the target device is a second device, the target device can place the received display information of the target projection content into a MediaCodec decoder for H.264 decoding to generate the aforementioned first image.
[0780] The target device contains the first image as a Surface object, which is passed to OpenGL for drawing, similar to screen redrawing. The points in the first image whose RGB pixel values are all 255 are filtered, that is, all white areas are selected, and when OpenGL rendering is performed, they are changed to paper-like RGB values or light green RGB values, thereby adjusting the blank areas to eye-protection colors. And when OpenGL rendering is performed, the text and picture colors in the first image are enhanced to improve the projection effect and clarity, to prevent the problem of blurred images and difficult to recognize content when projecting to a higher-resolution screen, and to prevent excessive eye use. For details, see the text enhancement and picture color enhancement processing described later. The second image after the first image is rendered and drawn by OpenGL can be used as the eye protection content corresponding to the target projection content.
[0781] Optionally, if the target device is the first device, the target device may place the second image into a MediaCodec encoder for H.264 encoding and video compression to obtain display information corresponding to the eye protection content and send the information to the second device. The second device may place the display information corresponding to the eye protection content into a MediaCodec decoder for H.264 decoding to facilitate display of the eye protection content.
[0782] In some examples, the target device can perform text enhancement on the first image. The target device can recognize text in a document scenario based on a text recognition method based on a convolutional recurrent neural network (CRNN). This model is mainly used to solve the image sequence recognition problem of scene text recognition. It can achieve end-to-end recognition of an entire line of text without the need for character cutting, and the number of CRNN model parameters is small, which is conducive to applying the model to devices with low computing power. First, it is necessary to obtain the text position area. This solution uses the YOLO model to perform neural network prediction of a single-stage algorithm. By pre-defining candidate areas, a prediction box is generated for annotation, and the output vector of each network corresponding to the input image is determined, and finally the position of the detected object is obtained. Afterwards, an end-to-end CRNN algorithm is used for feature extraction, sequence information conversion and decoding, namely the CNN+RNN+CTC model. The CNN extracts image pixel features as the convolutional layer; the RNN extracts feature sequence information as the recurrent layer. A bidirectional RNN network, BiLSTM, is used to obtain the label distribution of the feature sequence in the convolutional layer for prediction. The transcription layer is jointly trained using the CTC loss function, and the label distribution obtained from the recurrent layer is decoded through operations such as deduplication and integration to obtain the final recognition result. Finally, OpenGL is used to enhance the text color and improve the text display quality.
[0783] In some examples, the target device can perform color enhancement on the image in the first image. Color enhancement refers to adjusting the saturation characteristics of images and videos to make the colors richer and more realistic, thereby enhancing the subjective visual experience. Color enhancement, combined with techniques such as video noise reduction, dark light enhancement, contrast adjustment, and edge enhancement, can significantly improve image quality. The target device can use a natural saturation adjustment method based on the HSV color model. This method converts the RGB color model to the HSV color model, where HSV represents hue, saturation, and value. Adjusting saturation solely through OpenGL can enhance color vividness without affecting brightness or hue. The target device can then classify the noise captured in the image based on the color space into luma noise and chroma noise. In color enhancement applications, amplifying color noise is a common problem. Therefore, it is important to avoid this during image color enhancement. Based on the statistical characteristics of color noise, it is necessary to assess the noise and reduce the intensity of color enhancement in these areas to suppress noise.
[0784] Optionally, when the first image contains an image containing the task, skin color protection can be performed. For example, a common Gaussian model method based on HS for skin color recognition can be used. This method is adopted by the open source processing library GPUImage. The basic idea is to convert RGB to HSV space and calculate the distance between h and skinHue: dist = abs(h-skinHue) / 0.5, where skinHue is the statistical mean of the Gaussian model, generally 0.05. The statistical parameter related to the variance of the Gaussian model is skinHueThreshold, which is generally 40. The Gaussian weight is obtained using the formula exp(-dist*dist*skinHueThreshold). This method only calculates the weight (probability) of skin color recognition, and the skin color detection result can be obtained later by setting a threshold (for example, >0.90).
[0785] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a second device. As shown in Figure 15A, the method may include:
[0786] S1501A, the second device receives first display information of the target projection content, where the first display information is generated by the first device.
[0787] S1502A: The second device generates first eye protection content corresponding to the target projection content according to the first display information;
[0788] S1503A: The second device displays the first eye protection content.
[0789] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates first eye protection content corresponding to the target screen projection content based on the first display information, including:
[0790] The second device generates first eye protection content corresponding to the target projection content according to the first display information in response to the first instruction; or
[0791] In response to detecting that the target projection content meets the first eye protection condition, the second device generates the first eye protection content according to the first display information; or
[0792] The second device generates the first eye protection content according to the first display information in response to detecting that the ambient light parameter meets the second eye protection condition, wherein the ambient light parameter is sent by the first device or collected by the second device; or
[0793] In response to detecting that the target projection content is content in an object of a preset type, the second device generates the first eye protection content according to the first display information.
[0794] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first instruction is generated on the second device.
[0795] In one possible design, in the screen projection display method provided in the embodiment of the present application, the method further includes:
[0796] The second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations:
[0797] a first operation of the user on the input device of the second device;
[0798] a second operation performed by the user on a virtual key displayed by the second device;
[0799] a third operation of the user on the touch display device of the second device;
[0800] Preset voice control operations;
[0801] Preset gesture control operations.
[0802] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first instruction is sent by the first device to the second device.
[0803] In one possible design, the first display information is a video stream;
[0804] The second device decodes the first display information to obtain the target projection content.
[0805] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates first eye protection content corresponding to the target screen projection content based on the first display information, including:
[0806] The second device identifies a background area in the target projection content;
[0807] The second device generates the first eye protection content based on the background area.
[0808] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device identifies the background area in the target screen projection content, including:
[0809] The second device identifies a target element in the target projection content;
[0810] The second device determines the background area in the target projection content based on the detected target element.
[0811] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates the first eye protection content based on the background area, including:
[0812] The second device performs background eye protection processing on the background area to obtain a target optimized background image;
[0813] The second device generates the first eye protection content based on the target optimized background image.
[0814] In one possible design, in the screen projection display method provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0815] Set an image with a preset texture as the image in the target area;
[0816] adjusting the color of the image in the target area;
[0817] Performing grayscale processing on the image in the target area;
[0818] The target area is a partial area or the entire area of the background area.
[0819] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates the first eye protection content based on the background area, including:
[0820] The second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0821] The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
[0822] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates first eye protection content corresponding to the target screen projection content based on the first display information, including:
[0823] The second device generates the first eye protection content based on the detected elements and the target eye protection mode parameters.
[0824] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates the first eye protection content based on the detected elements and the target eye protection mode parameters, including:
[0825] In some examples, if the target eye protection mode parameter is the first eye protection mode parameter, that is, the second device is in the first eye protection mode, the second device executes the first generation method. The first generation method includes the following operations:
[0826] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0827] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0828] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0829] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0830] The second device generates the first eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The second device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the first eye protection content.
[0831] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates the first eye protection content based on the detected elements and the target eye protection mode parameters, including:
[0832] If the target eye protection mode parameter is the second eye protection mode parameter, that is, the second device is in the second eye protection mode, the second device executes the second generation method, where the second generation method includes the following operations:
[0833] The second device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0834] The second device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The second device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0835] For the background area in the target projection content, the second device can perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area can be a partial area or the entire area of the background area.
[0836] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the second device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0837] The second device performs grayscale processing on the content to be processed to generate the first eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the second device can first generate the content to be processed, and the second device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The second device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. The second device can then perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the first eye protection content.
[0838] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device generates the first eye protection content based on the detected elements and the target eye protection mode parameters, including:
[0839] If the target eye protection mode parameter is the third eye protection mode parameter, that is, the second device is in the third eye protection mode, the second device executes a third generation method, where the third generation method includes the following operations:
[0840] The second device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the second device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The second device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain a second optimized image element corresponding to the target second element. Optionally, the second device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0841] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0842] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0843] If the target area exists in the background area, the second device can adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The second device generates the first eye protection content based on the second optimized picture element and the target optimized background image.
[0844] If the target area does not exist in the background area, the second device may generate the first eye protection content according to the second optimized picture element.
[0845] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a first device. As shown in Figure 15B, the method may include:
[0846] S1501B, the first device obtains the target projection content.
[0847] S1502B, the first device generates first display information of the target projection content, and sends the first display information to the second device, so that the second device generates first eye protection content corresponding to the target projection content.
[0848] Optionally, the first device may send a first instruction to the second device so that the second device responds to the first instruction and generates first eye protection content corresponding to the target projection content according to the first display information.
[0849] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a first device. As shown in Figure 16A, the method may include:
[0850] S1601A, the first device obtains the target projection content.
[0851] S1602A: The first device generates second eye protection content corresponding to the target projection content according to the target projection content;
[0852] S1603A: The first device sends second display information of the second eye protection content to the second device.
[0853] In one possible design, the screen projection display method may further include:
[0854] The first device opens the target screen projection content and displays the target screen projection content in a preset display area;
[0855] The first device displays the second eye protection content in the display area and records the screen of the display area, and the generated video stream is the second display information.
[0856] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content based on the target screen projection content, including:
[0857] The first device generates second eye protection content corresponding to the target projection content according to the target projection content in response to the second instruction; or
[0858] The first device generates second eye protection content corresponding to the target projection content based on the target object being a file of a preset type; or
[0859] The first device generates the second eye protection content in response to detecting that the target projection content meets the first eye protection condition; or
[0860] In response to detecting that the ambient light parameter meets the second eye protection condition, the first device generates the second eye protection content.
[0861] In one possible design, in the screen projection display method provided in the embodiment of the present application, the method further includes:
[0862] The first device generates the second instruction in response to detecting a second target operation; the second target operation is any one of the following operations:
[0863] a fourth operation of the user on the input device of the first device;
[0864] a fifth operation performed by the user on the virtual key displayed on the first device;
[0865] a sixth operation performed by the user on the touch display device of the first device;
[0866] Preset voice control operations;
[0867] Preset gesture control operations.
[0868] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second instruction is sent by the second device to the first device.
[0869] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content based on the target screen projection content, including:
[0870] The first device identifies a background area in the target projection content;
[0871] The first device generates the second eye protection content based on the background area.
[0872] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device identifies the background area in the target screen projection content, including:
[0873] The first device identifies a target element in the target projection content;
[0874] The first device determines a background area in the target projection content based on the detected target element.
[0875] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates the second eye protection content based on the background area, including:
[0876] The first device performs background eye protection processing on the background area to obtain a target optimized background image;
[0877] The first device generates the second eye protection content based on the target optimized background image.
[0878] In one possible design, in the screen projection display method provided in the embodiment of the present application, the background eye protection processing includes one or more of the following processing operations:
[0879] Set an image with a preset texture as the image in the target area;
[0880] adjusting the color of the image in the target area;
[0881] Performing grayscale processing on the image in the target area;
[0882] The target area is a partial area or the entire area of the background area.
[0883] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content based on the target screen projection content, including:
[0884] The first device identifies a target element in the target projection content;
[0885] The first device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type;
[0886] The first device optimizes the background image and the optimized elements according to the target to generate the second eye protection content.
[0887] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates second eye protection content corresponding to the target screen projection content based on the target screen projection content, including:
[0888] The first device identifies a target element in the target projection content;
[0889] The first device generates the second eye protection content based on the detected elements and the target eye protection mode parameters.
[0890] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates the second eye protection content based on the detected element and the target eye protection mode parameter, including:
[0891] In some examples, if the target eye protection mode parameter is a first eye protection mode parameter, that is, the first device is in the first eye protection mode, the first device executes a first generation method, wherein the first generation method includes the following operations:
[0892] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0893] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0894] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0895] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0896] The first device generates the second eye protection content based on the target optimized background image, the optimized text elements, and the first optimized picture elements. The first device may replace the image in the original background area of the target projection content with the target optimized background image, replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the second eye protection content.
[0897] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates the second eye protection content based on the detected element and the target eye protection mode parameter, including:
[0898] If the target eye protection mode parameter is the second eye protection mode parameter, that is, the first device is in the second eye protection mode, the first device executes the second generation method, where the second generation method includes the following operations:
[0899] The first device performs text enhancement processing on each first element to obtain an optimized text element corresponding to each first element. Optionally, the text enhancement processing can be text color enhancement processing on each first element and / or text edge thickening processing on the first element to obtain the optimized text element corresponding to the first element.
[0900] The first device performs image optimization processing on all or part of the second elements to obtain first optimized image elements corresponding to each second element in all or part of the second elements. Optionally, the first device may perform image optimization processing on the second elements that meet the image optimization condition. The image optimization condition may be that the image clarity is lower than a preset clarity. The first device may perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element and obtain the first optimized image element corresponding to the target second element.
[0901] For the background area in the target projection content, the first device may perform a first background eye protection process on the target area to obtain a target optimized background image corresponding to the background area, wherein the target area may be a partial area or the entire area of the background area.
[0902] Among them, the first background eye protection processing may include: setting an image with a preset texture as the image in the target area; adjusting the color of the image in the target area. For example, the first device adjusts the target area in the target projection content, and can set an image with a preset texture as the image in the target area, and adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. For example, the color number of the first color can be any one of the preset second color numbers. The second color number can be understood as the color number of the color with an eye protection effect. For example, the color number of the first color can be bcc1bd.
[0903] The first device performs grayscale processing on the content to be processed to generate the second eye protection content, wherein the content to be processed includes the target optimized background image, each optimized text element, and each first optimized picture element. Optionally, the first device can first generate the content to be processed, and the first device generates the content to be processed based on the target optimized background image, each optimized text element, and each first optimized picture element. The first device can replace the image in the original background area of the target projection content with the target optimized background image, and replace the text elements in the target projection content with the optimized text elements, and replace the corresponding picture elements with the first optimized picture elements to generate the content to be processed. Then the first device can perform grayscale processing on the content to be processed to adjust the overall color of the content to be processed to a black, white and gray effect to obtain the second eye protection content.
[0904] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first device generates the second eye protection content based on the detected element and the target eye protection mode parameter, including:
[0905] If the target eye protection mode parameter is the third eye protection mode parameter, that is, the first device is in the third eye protection mode, the first device executes a third generation method, where the third generation method includes the following operations:
[0906] The first device performs image optimization processing and adjusts the color temperature on all or part of the second elements to obtain second optimized image elements corresponding to each second element in the said all or part of the second elements. Optionally, the first device can perform image optimization processing on the second elements that meet the image optimization conditions. The image optimization condition can be that the image clarity is lower than the preset clarity. The first device can perform image optimization processing, such as super-resolution processing, on the target second element whose clarity is lower than the preset clarity among all the second elements to improve the clarity of the target second element. And adjust the color temperature of the target second element to obtain the second optimized image element corresponding to the target second element. Optionally, the first device can adjust the color temperature of the target second element so that its color temperature is less than or equal to the preset color temperature threshold. The preset color temperature threshold can be 5600k.
[0907] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0908] In one possible scenario, the target area may be an area within the background area that meets the adjustment condition. Alternatively, the preset adjustment condition may be that the image of the area includes an image of the first color. Alternatively, the preset adjustment condition may be that the image of the area includes at least one image of the first color, and the ratio of the number of pixels of each first color image to the number of pixels of the image of the background area is greater than or equal to a third pixel ratio threshold. The color number of the first color may be any one of the preset color numbers.
[0909] If the target area exists in the background area, the first device may adjust the color of the image in the target area to the first color to obtain a target optimized background image corresponding to the background area. The first device generates the second eye protection content based on the second optimized picture element and the target optimized background image.
[0910] If the target area does not exist in the background area, the first device may generate the second eye protection content according to the second optimized picture element.
[0911] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a second device. As shown in Figure 16B, the method may include:
[0912] S1601B: The second device receives second display information.
[0913] S1602B: The second device displays second eye protection content according to the second display information.
[0914] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a second device. As shown in Figure 17A, the method may include:
[0915] S1701A, the second device receives first display information of the target projection content, and the first display information is generated by the first device.
[0916] S1702A: The second device obtains target ambient light parameters.
[0917] S1703A: The second device determines display parameters according to the target ambient light parameters.
[0918] S1704A: The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information;
[0919] S1705A: The second device displays the third eye protection content.
[0920] In one possible design, in the screen projection display method provided in an embodiment of the present application, the second device is configured with multiple sets of display parameters; a set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature;
[0921] The second device determines a display parameter according to the target ambient light parameter, including:
[0922] The second device determines the target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters;
[0923] The second device adjusts the target projection content according to the parameters in the target group display parameters to generate the third eye protection content.
[0924] In one possible design, the second device determines a target screen brightness corresponding to the target ambient light parameter based on a preset correspondence between the ambient light parameter and the screen brightness;
[0925] The second device displays the third eye protection content according to the target screen brightness.
[0926] In one possible design, in the screen projection display method provided in an embodiment of the present application, the target ambient light parameter is sent by the first device to the second device.
[0927] In one possible design, in the screen projection display method provided in an embodiment of the present application, the target ambient light parameter is carried by a third instruction sent by the first device to the second device;
[0928] The second device determines a display parameter according to the target ambient light parameter, including:
[0929] The second device adjusts the display parameter according to the target ambient light parameter in response to the third instruction.
[0930] In one possible design, in the screen projection display method provided in an embodiment of the present application, the target ambient light parameters are collected by the second device.
[0931] In one possible design, in the screen projection display method provided in an embodiment of the present application, the first display information is a video stream; the method further includes:
[0932] The second device decodes the first display information to obtain the target projection content.
[0933] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to the first device. As shown in Figure 17B, the method may include:
[0934] S1701B, the first device generates first display information of the target projection content and sends the first display information to the second device.
[0935] In one possible design, the first device opens the target projection content and displays the target projection content in a preset display area; the first device records the display area, and the generated video stream is the first display information.
[0936] S1702B, the first device obtains target ambient light parameters and sends the target ambient light parameters to the second device, so that the second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information.
[0937] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to the first device. As shown in Figure 17C, the method may include:
[0938] S1701C, the first device obtains target ambient light parameters and target projection content.
[0939] S1702C: The first device determines display parameters according to the target ambient light parameters;
[0940] S1703C: The first device generates fourth eye protection content corresponding to the target projection content based on the display parameters and the first display information.
[0941] S1704C: The first device sends third display information of the fourth eye protection content to the second device, so that the second device displays the fourth eye protection content.
[0942] Based on the screen projection display system and screen projection display method provided in any of the above embodiments, the present application also provides a screen projection display method that can be applied to a second device. As shown in Figure 17D, the method may include:
[0943] S1701D: The second device receives third display information.
[0944] S1702D: The second device displays the fourth eye protection content according to the third display information.
[0945] In one possible implementation, the second device obtains the target ambient light parameter; the second device determines the target screen brightness based on the target ambient light parameter; and the second device displays the fourth eye protection content based on the target screen brightness and the third display information.
[0946] In a possible implementation, the second device determines the target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness.
[0947] In one possible implementation, the second device receives a target screen brightness sent by the first device, and displays the fourth eye protection content based on the target screen brightness and the third display information.
[0948] On the other hand, an embodiment of the present application further provides an electronic device, comprising a memory and a controller, wherein:
[0949] The memory stores computer program instructions;
[0950] The controller executes the computer program instructions to implement the steps in any one of the screen projection display methods provided in Figures 11A to 17B.
[0951] On the other hand, an embodiment of the present application further provides an electronic device that is communicatively connected to a first device, the first device being a screen projection sending terminal, and the electronic device being a screen projection receiving terminal; wherein the electronic device includes a display and a controller, wherein:
[0952] The display is configured to display content;
[0953] The controller is configured to:
[0954] Receiving first display information of target screen projection content, where the first display information is generated by a first device;
[0955] generating first eye protection content corresponding to the target projection content according to the first display information;
[0956] The first eye protection content is displayed.
[0957] In one possible design, the controller is specifically configured to execute:
[0958] In response to the first instruction, generating first eye protection content corresponding to the target projection content according to the first display information; or,
[0959] In response to detecting that the target projection content meets the first eye protection condition, generating the first eye protection content according to the first display information; or,
[0960] In response to detecting that an ambient light parameter meets a second eye protection condition, the first eye ...
Claims
1. A projection display system, wherein: The system comprises a first device and a second device, wherein the first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The first device generates first display information of the target screen projection content, and sends the first display information to the second device; The second device generates first eye protection content corresponding to the target projection content according to the first display information; The second device displays the first eye protection content.
2. The system of claim 1, wherein: The second device generates first eye protection content corresponding to the target projection content according to the first display information in response to the first instruction; or In response to detecting that the target projection content meets the first eye protection condition, the second device generates the first eye protection content according to the first display information; or, The second device generates the first eye protection content according to the first display information in response to detecting that the ambient light parameter meets the second eye protection condition, wherein the ambient light parameter is sent by the first device or collected by the second device; or In response to detecting that the target projection content is content in an object of a preset type, the second device generates the first eye protection content according to the first display information.
3. The system of claim 2, wherein: The first instruction is generated on the second device; or When the first device detects the second target operation, the first device sends the first instruction to the second device; or The first device sends the first instruction to the second device based on the target projection content being content in an object of a preset type.
4. The system of claim 3, wherein: The second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations: a first operation of the user on the input device of the second device; a second operation performed by the user on a virtual key displayed by the second device; a third operation of the user on the touch display device of the second device; Preset voice control operations; Preset gesture control operations.
5. The system of claim 1, wherein: The first display information is a video stream; The second device decodes the first display information to obtain the target projection content.
6. The system of claim 1, wherein: The second device identifies a background area in the target projection content; The second device generates the first eye protection content based on the background area.
7. The system of claim 6, wherein: The second device identifies a target element in the target projection content; The second device determines the background area in the target projection content based on the detected target element.
8. The system of claim 6 or 7, wherein: The second device performs background eye protection processing on the background area to obtain a target optimized background image; The second device generates the first eye protection content based on the target optimized background image.
9. The system of claim 8, wherein: The background eye protection processing includes one or more of the following processing operations: Set an image with a preset texture as the image in the target area; adjusting the color of the image in the target area; Performing grayscale processing on the image in the target area; The target area is a partial area or the entire area of the background area.
10. The system of claim 8, wherein: The second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type; The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
11. A screen projection display system, wherein: The system comprises a first device and a second device, wherein the first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The first device obtains target screen projection content; The first device generates second eye protection content corresponding to the target projection content according to the target projection content; The first device sends second display information of the second eye protection content to the second device; The second device displays the second eye protection content according to the second display information.
12. The system of claim 11, wherein: The first device opens the target screen projection content and displays the target screen projection content in a preset display area; The first device displays the second eye protection content in the display area and records the screen of the display area, and the generated video stream is the second display information.
13. The system of claim 11, wherein: The first device generates second eye protection content corresponding to the target projection content according to the target projection content in response to the second instruction; or The first device generates second eye protection content corresponding to the target projection content based on the target object being a file of a preset type; or, In response to detecting that the target projection content meets the first eye protection condition, the first device generates the second eye protection content; or, In response to detecting that the ambient light parameter meets the second eye protection condition, the first device generates the second eye protection content.
14. The system of claim 13, wherein: The second instruction is sent by the second device to the first device; or The first device generates the second instruction in response to detecting a second target operation; the second target operation is any one of the following operations: a fourth operation of the user on the input device of the first device; a fifth operation performed by the user on the virtual key displayed on the first device; a sixth operation performed by the user on the touch display device of the first device; Preset voice control operations; Preset gesture control operations.
15. The system of claim 14, wherein: When the second device detects the first target operation, it sends the second instruction to the first device.
16. The system of claim 11, wherein: The first device identifies a background area in the target projection content; The first device generates the second eye protection content based on the background area.
17. The system of claim 16, wherein: The first device identifies a target element in the target projection content; The first device determines a background area in the target projection content based on the detected target element.
18. The system of claim 16 or 17, wherein: The first device performs background eye protection processing on the background area to obtain a target optimized background image; The first device generates the second eye protection content based on the target optimized background image.
19. The system of claim 18, wherein: The background eye protection processing includes one or more of the following processing operations: Set an image with a preset texture as the image in the target area; adjusting the color of the image in the target area; Performing grayscale processing on the image in the target area; The target area is a partial area or the entire area of the background area.
20. The system of claim 18, wherein: The first device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type; The first device optimizes the background image and the optimized elements according to the target to generate the second eye protection content.
21. A projection display system, wherein: The system comprises a first device and a second device, wherein the first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The first device generates first display information of the target screen projection content, and sends the first display information to the second device; The second device obtains target ambient light parameters; The second device determines display parameters according to the target ambient light parameters; The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information; The second device displays the third eye protection content.
22. The system of claim 21, wherein: The second device is configured with multiple sets of display parameters; A set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature; The second device determines the target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters; The second device adjusts the target projection content according to the parameters in the target group display parameters to generate the third eye protection content.
23. The system of claim 21, wherein: The second device determines the target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness; The second device displays the third eye protection content according to the target screen brightness.
24. The system of claim 23, wherein: The target ambient light parameter is sent by the first device to the second device; or, The first device sends a third instruction to the second device, where the third instruction carries the target ambient light parameter; And the second device adjusts the display parameter according to the target ambient light parameter in response to the third instruction.
25. The system of claim 21, wherein: The target ambient light parameter is collected by the second device.
26. The system of claim 21, wherein: The first device opens the target screen projection content and displays the target screen projection content in a preset display area; the first device records the screen of the display area, and the generated video stream is the first display information; The second device decodes the first display information to obtain the target projection content.
27. A screen projection display method, wherein: Applied to a second device, a first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The second device receives first display information of the target screen projection content, where the first display information is generated by the first device; The second device generates first eye protection content corresponding to the target projection content according to the first display information; The second device displays the first eye protection content.
28. A screen projection display method, wherein: Applied to a first device, the first device is in communication with a second device, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The first device obtains target projection content; The first device generates first display information of the target projection content and sends the first display information to the second device, so that the second device generates first eye protection content corresponding to the target projection content.
29. A screen projection display method, wherein: Applied to a first device, the first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The first device obtains target projection content; The first device generates second eye protection content corresponding to the target screen projection content according to the target screen projection content; The first device sends second display information of the second eye protection content to the second device.
30. A screen projection display method, wherein: Applied to a second device, a first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The second device receives second display information, where the second display information is generated by the first device; The second device displays second eye protection content according to the second display information.
31. A screen projection display method, wherein: Applied to a second device, a first device and the second device are in communication connection, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The second device receives first display information of the target screen projection content, where the first display information is generated by the first device; The second device obtains target ambient light parameters; The second device determines display parameters according to the target ambient light parameters; The second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information; The second device displays the third eye protection content.
32. A screen projection display method, wherein: Applied to a first device, the first device is in communication with a second device, the first device is a screen projection sending terminal, and the second device is a screen projection receiving terminal; The method comprises: The first device generates first display information of the target screen projection content, and sends the first display information to the second device; The first device obtains target ambient light parameters and sends the target ambient light parameters to the second device, so that the second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information.
33. An electronic device is connected to a first device for communication, wherein the first device is a screen projection sending terminal and the electronic device is a screen projection receiving terminal; wherein: The electronic device comprises a display and a controller, wherein: The display is configured to display content; The controller is configured to: Receiving first display information of target screen projection content, where the first display information is generated by a first device; generating first eye protection content corresponding to the target projection content according to the first display information; The first eye protection content is displayed.
34. The apparatus of claim 33, wherein: The controller is specifically configured to execute: In response to the first instruction, generating first eye protection content corresponding to the target projection content according to the first display information; or, In response to detecting that the target projection content meets the first eye protection condition, generating the first eye protection content according to the first display information; or, In response to detecting that an ambient light parameter meets a second eye protection condition, the first eye protection content is generated according to the first display information, where the ambient light parameter is sent by the first device or collected by the second device.
35. The apparatus of claim 34, wherein: The first instruction is generated on the electronic device; or, When the first device detects the second target operation, the first device sends the first instruction to the electronic device; or The first device sends the first instruction to the electronic device based on the target projection content being content in a file of a preset type.
36. The apparatus of claim 35, wherein: The controller is further configured to perform: The second device generates the first instruction in response to detecting a first target operation; the first target operation is any one of the following operations: a first operation of the user on the input device of the second device; a second operation performed by the user on a virtual key displayed by the second device; a third operation of the user on the touch display device of the second device; Preset voice control operations; Preset gesture control operations.
37. The apparatus of claim 33, wherein: The first display information is a video stream; The controller is specifically configured to execute: Decode the first display information to obtain the target projection content.
38. The apparatus of claim 33, wherein: The controller is specifically configured to execute: Identifying a background area in the target projection content; The first eye protection content is generated based on the background area.
39. The apparatus of claim 38, wherein: The controller is further configured to perform: The second device identifies a target element in the target projection content; The second device determines the background area in the target projection content based on the detected target element.
40. The apparatus of claim 37 or 38, wherein The controller is specifically configured to execute: Performing background eye protection processing on the background area to obtain a target optimized background image; The first eye protection content is generated based on the target optimized background image.
41. The apparatus of claim 40, wherein: The background eye protection processing includes one or more of the following processing operations: Set an image with a preset texture as the image in the target area; adjusting the color of the image in the target area; Performing grayscale processing on the image in the target area; The target area is a partial area or the entire area of the background area.
42. The apparatus of claim 40, wherein: The controller is specifically configured to execute: The second device performs quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type; The second device generates the first eye protection content by optimizing the background image and the optimization elements according to the target.
43. An electronic device, wherein: The second device is communicatively connected to the second device, the electronic device is a screen projection sending terminal, and the first device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: Get the target screen content; Generate first display information corresponding to the target projection content; The first display information is sent to the second device so that the second device generates first eye protection content corresponding to the target projection content based on the first display information.
44. An electronic device, wherein: The second device is communicatively connected to the second device, the electronic device is a screen projection sending terminal, and the first device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: Get the target screen content; Generate second eye protection content corresponding to the target projection content according to the target projection content; Sending second display information of the second eye protection content to the second device.
45. The apparatus of claim 44, wherein: The controller is configured to perform: Open the target screen projection content and display it in a preset display area; The second eye protection content is displayed in the display area, and the display area is recorded, and the generated video stream is the second display information.
46. The apparatus of claim 44, wherein: The controller is configured to perform: In response to the second instruction, generating second eye protection content corresponding to the target projection content according to the target projection content; or, Based on the target object being a file of a preset type, generating second eye protection content corresponding to the target projection content according to the target projection content; or, In response to detecting that the target projection content meets the first eye protection condition, generating the second eye protection content; or, In response to detecting that the ambient light parameter meets the second eye protection condition, the second eye protection content is generated.
47. The apparatus of claim 46, wherein: The second instruction is sent by the second device to the electronic device; or The controller is configured to execute: in response to detecting a second target operation, generate the second instruction; the second target operation is any one of the following operations: a fourth operation of the user on the input device of the first device; a fifth operation performed by the user on the virtual key displayed on the first device; a sixth operation performed by the user on the touch display device of the first device; Preset voice control operations; Preset gesture control operations.
48. The apparatus of claim 47, wherein When the second device detects the first target operation, it sends the second instruction to the electronic device.
49. The apparatus of claim 44, wherein: The controller is specifically configured to execute: Identifying a background area in the target projection content; The second eye protection content is generated based on the background area.
50. The apparatus of claim 49, wherein The controller is specifically configured to execute: Identifying a target element in the target projection content; Based on the detected target element, determine the background area in the target projection content.
51. The apparatus of claim 49 or 50, wherein The controller is specifically configured to execute: Performing background eye protection processing on the background area to obtain a target optimized background image; The second eye protection content is generated based on the target optimized background image.
52. The apparatus of claim 51, wherein The background eye protection processing includes one or more of the following processing operations: Set an image with a preset texture as the image in the target area; adjusting the color of the image in the target area; Performing grayscale processing on the image in the target area; The target area is a partial area or the entire area of the background area.
53. The apparatus of claim 51, wherein The controller is specifically configured to execute: Performing quality improvement processing on some or all of the target elements to obtain optimized elements corresponding to the target elements, where the detected target elements include a first element whose element type is a text type, or a second element whose element type is a picture type; The background image and the optimized elements are optimized according to the target to generate the second eye protection content.
54. An electronic device, wherein: The first device is communicatively connected to the first device, the first device is a screen projection sending terminal, and the electronic device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: receiving second display information; Second eye protection content is displayed according to the second display information, where the second eye protection content is generated by the first device.
55. An electronic device, wherein: The first device is communicatively connected to the first device, the first device is a screen projection sending terminal, and the electronic device is a screen projection receiving terminal; the electronic device includes a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: Receiving first display information of target screen projection content, where the first display information is generated by the first device; Get target ambient light parameters; determining display parameters according to the target ambient light parameters; Based on the display parameters and the first display information, generating third eye protection content corresponding to the target projection content; The third eye protection content is displayed.
56. The apparatus of claim 55, wherein: The controller is configured with multiple sets of display parameters; A set of display parameters includes one or more parameters of contrast, saturation, hue, image quality, and color temperature; The controller is specifically configured to execute: Determining a target group of display parameters corresponding to the target ambient light parameters according to a preset correspondence between the ambient light parameters and the plurality of groups of display parameters; According to the various parameters in the target group display parameters, the target projection content is adjusted to generate the third eye protection content.
57. The apparatus of claim 55, wherein: The controller is specifically configured to execute: Determining a target screen brightness corresponding to the target ambient light parameter according to a preset correspondence between the ambient light parameter and the screen brightness; The second device displays the third eye protection content according to the target screen brightness.
58. The apparatus of claim 57, wherein The target ambient light parameter is sent by the first device to the electronic device; or, The first device sends a third instruction to the second device, where the third instruction carries the target ambient light parameter, and the controller is specifically configured to execute: in response to the third instruction, adjust the display parameter according to the target ambient light parameter.
59. The apparatus of claim 55, wherein: The target ambient light parameter is collected by the electronic device.
60. The apparatus of claim 55, wherein: The first display information is a video stream; The controller is specifically configured to execute: decoding the first display information to obtain the target projection content.
61. An electronic device, wherein: Communicate with a second device, the electronic device being a screen projection sending terminal and the second device being a screen projection receiving terminal; the electronic device including a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: Generate first display information of the target screen projection content, and send the first display information to the second device; Obtain target ambient light parameters and send the target ambient light parameters to the second device, so that the second device generates third eye protection content corresponding to the target projection content based on the display parameters and the first display information.
62. The electronic device of claim 61 , wherein the controller is further configured to: Open the target projection content and display it in a preset display area; record the display area, and the generated video stream is the first display information.
63. An electronic device, wherein: The electronic device comprises a memory and a controller, wherein: The memory stores computer program instructions; The controller executes the computer program instructions to implement: the steps in the screen projection display method as described in any one of claims 27-32.
64. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 27 .
65. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 28 .
66. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 29 .
67. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 30 .
68. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 31 .
69. A computer-readable storage medium, wherein: The computer-readable storage medium is used to store a computer program, which, when executed on a computer, causes the computer to perform the method according to claim 32 .